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(57) On an information recording medium, an entire 
stream including a plurality of portion streams, each of 
which is provided with picture infonmation or audio infor- 
mation constituting a series of content, is muitiplexed- 
and-recorded by a unit of packet. The infoimation re- 
cording medium is provided with a file for storing object 
data, which is constructed by a plurality of packets, each 
of which stores therein a piece of the picture Infonnation 
or the audio infonnation. The Infonnation recording me- 
dium is further provided with a file for storing infonnation 
which defines a reproduction sequence of the object da- 
ta and a file for storing information which defines a group 
having a specific relation from among a pluraiity of the 
plurality of portion streams. 
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Description 

Technical Field 

[0001 ] The present invention reiates to an infonnatlon 
recording medium, such as a high-density optical disc, 
on which various information can be recorded at high 
density, such as main picture Infonnation, audio infor- 
mation, sub picture infonnation, and reproduction con- 
trol infonnation, an apparatus for and a method of re- 
cording the infonnatlon onto the Infonnatlon recording 
medium, an apparatus for and a method of reproducing 
the information from the infonnation recording medium, 
an apparatus and a method capable of both recording 
and reproducing the information, a computer program 
for controlling the record or the reproduction, and a data 
structure including a control signal for controlling the re- 
production. 

Background Art 

[0002] DVDs are generalized as optical discs on 
which various infonnation is recorded, such as the video 
infonnation, the audio infonnation, the sub picture infor- 
mation, and the reproduction control information. Ac- 
cording to the DVD standard, the video Infonnatlon (e. 
g. video data), the audio Information (e.g. audio data), 
and the sub picture information (e.g. sub picture data) 
are individually packetized with the reproduction control 
infonnation (e.g. navigation data) and are multiplexed 
and recorded on a disc in the "program stream" fonnat 
of the MPEG 2 (Moving Picture Experts Group phase 2) 
standard, which is a highly efficient encoding technique. 
In the video information among them, there Is only one 
stream of data compressed according to the MPEG vid- 
eo fonnat (IS0 1 381 8-2) within one program stream. On 
the other hand, the audio information is recorded in a 
plurality of methods (namely, linear PCM, AC-3, MPEG 
audio, and the like). The audio information can exist up 
to 8 streams within one program stream. The sub picture 
Infonnatlon is defined with a bit map and is compressed 
and recorded in a run-length method. The sub picture 
infonnation can exist up to 32 streams within one pro- 
gram stream. In the case of the DVD, as described 
above, a plurality of streams of the chooseable or se- 
lectable audio Infonnatlon (e.g. streams of a stereo 
sound, a surrounding sound, an original English sound, 
a dubbed Japanese sound, and the like) and a plurality 
of streams of the chooseable or selectable sub picture 
infonnation (e.g. streams of Japanese subtitle, English 
subtitle, and the like) are multiplexed and recorded by 
using the program stream format, for one stream of the 
video infonnation in one movie or film, for example. 
[0003] On the other hand, the "transport stream" for- 
mat of the MPEG 2 standard has been recently stand- 
ardized, and this is appropriate for higher capacity or 
higher speed data transmission. According to this trans- 
port stream fonnat, a plurality of "elementary streams" 
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are transmitted at the same time at a much higher trans- 
mission rate than that of the above described program 
stream format. For example, a plurality of shows or pro- 
grams, such as many TV channels of satellite digital 

5 broadcasting, are time-division-multipiexed to one sat- 
ellite wave and are transmitted at the same time. Name- 
ly, in the transport stream fonnat, It is possible to time- 
division-multiplex the elementary streams of a plurality 
of videos, each of which has a large data amount, and 

10 transmit them at the same time. For example, it Is pos- 
sible to transmit at the same time a plurality of movies 
recorded on a plurality of DVDs. 
[0004] Moreover, if employing the transport stream 
format described above, "multiple broadcasting" or 

is "multi-view broadcasting" is also possible, which can 
perfonn in real time an angle change similar to the angle 
reproduction function (i.e. a function of automatically re- 
producing a picture of an angle by preparing a plurality 
of camera angles for one story and specifying the angle 

20 which a user would like to see), which has been already 
realized in the DVD standard, for example. More specif- 
ically, according to the "multiple broadcasting", transmit- 
ting at the same time a plurality of camera angle pictures 
about one live coverage or one story as a plurality of 

25 elementary streams of the video infonnatlon as one 
show or program enables the user to freely change In 
real time the pictures of the desired elementary streams 
one to another and to watch them, while the user is 
watching this one show or program through a tuner 

30 

Disclosure of Invention 

[0005] However, in the above described DVD, al- 
though the video of one stream can be multiplexed and 

35 recorded with the audio infonnation, the sub picture in- 
formation, and the like of a plurality of streams, the vid- 
eos of the plurality of streams cannot be multiplexed and 
recorded. Namely, the DVD, on which recording is per- 
fonned on the basis of the program stream fonnat of the 

40 MPEG 2, has such a problem that a plurality of shows 
or programs cannot be essentially multiplexed and re- 
corded thereon, which are transmitted at that same time 
in the transport stream fonnat of the MPEG 2 as de- 
scribed above. 

45 [0006] Moreover, even If there Is a disc which has 
such a high transmission rate and has such a high re- 
cording capacity or such a high recording density as to 
be capable of recording at the same time the plurality of 
shows or programs transmitted In the transport stream 

50 fonnat, the DVD still has such a technical problem that 
it is difficult or almost impossible to judge which elemen- 
tary stream pair or group (e.g. a pair of a video stream 
and an audio stream, a group obtained adding a sub 
picture stream to the above pair) corresponds to a de- 

55 sired show or program to reproduce from among a plu- 
rality of elementary streams in a bundle, when repro- 
ducing the disc. 

[0007] Furthennore, In the case of the multiple broad- 
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casting described above, an interpretation rule on the 
tuner side when the elementary streams of a plurality of 
video information corresponding to a plurality of pro- 
grams for one show are transmitted at the same time 
and an interpretation rule on the tuner side when the 
elementary streams of a plurality of video infonnation 
corresponding to one program for one show are trans- 
mitted at the same time, can be freely detennlned as a 
local rule for each country or each district, according to 
the transport stream fomnat of the IVIPEQ 2. Therefore, 
even If there is the disc, which has such a high trans- 
mission rate and has such a high receding capacity or 
such a high recording density as to be capable of re- 
cording at the same time the plurality of shows or pro- 
grams transmitted in the transport stream fomnat of the 
M PEG 2, In the case where the plurality of shows, whose 
interpretation rules differ from each other as the local 
rule, are recorded on this disc, there is left such a tech- 
nical problem that It is difficult or almost Impossible to 
judge which elementary streams or which videos can be 
freely switched to each other, when reproducing the 
disc. Especially, in the case of recording on one disc the 
multiple-broadcasted show whose interpretation rules 
differ as described above, it is conceivable that the han- 
dling or response by an information reproducing appa- 
ratus must be complicate and difficult. Alternatively, in 
order to enable the multiple broadcasting to be repro- 
duced in the same interpretation rules at a plurality of 
infomnation reproducing apparatuses whose set Inter- 
pretation rules differ from each other, there is left such 
a technical problem that it Is necessary to apply a 
change onto the elementary stream fomiat when re- 
cording. 

[0008] It is therefore an object of the present invention 
to provide an information recording medium, an appa- 
ratus for and a method of recording infomnation, an ap- 
paratus for and a method of reproducing the infonnation, 
an apparatus for and a method of recording and repro- 
ducing the infonnation, a computer program for control- 
ling the record or the reproduction, and a data structure 
including a control signal for controlling the reproduc- 
tion, which make it possible to multiplex and record a 
plurality of shows or programs and relatively simply re- 
produce a desired one from among them. 
[0009] The above object of the present invention can 
be achieved by an infonnation recording medium on 
which an entire stream including a plurality of portion 
streams, each of which is provided with picture informa- 
tion or audio infonmation constituting a series of content, 
is multiplexed-and-recorded by a unit of packet, which 
is a physically accessible unit, the infomnation recording 
medium provided with: an object data file for storing ob- 
ject data, which Is a logically accessible unit and is con- 
structed by a plurality of packets, each of which stores 
therein a piece of the picture Infomnation or the audio 
infomnation; a reproduction sequence information file for 
storing reproduction sequence infomnation which de- 
fines a reproduction sequence of the object data stored 



in the object data file; and an object information file for 
storing, as reproduction control information for control- 
ting a reproduction of the object data file, (i) correspond- 
ence definition information which defines a correspond- 
5 ence relationship between a plurality of packets, which 
are multiplexed on a time axis, and the plurality of por- 
tion streams and (ii) related group definition infomnation 
which defines as a related group a group having a spe- 
cific relation from among a plurality of series of contents 
10 constituting the plurality of portion streams. 

[0010] According to the infonnation recording appa- 
ratus of the present invention, the entire stream, such 
as at least one portion of the transport stream of the 
MPEG 2, is provided with a plurality of portion streams, 
IS such as elementary streams. Each of the portion 
streams is provided with picture information (e.g. video 
data and sub picture data) or audio information (e.g. au- 
dio data) constituting a series of content, which can be 
reproduced by the infonnation reproducing apparatus. 
Namely, one "portion stream" herein indicates one data 
array or infonnation array, such as the video stream, the 
audio stream, and the sub picture stream constituting a 
series of content, which can be, for example, the ele- 
mentary stream. On the other hand, one "entire stream" 
herein indicates the data array or information an'ay 
made by a plurality of portion streams In a bundle. The 
entire stream may be the transport stream itself made 
by m elementary streams in a bundle of the MPEG 2 (m: 
natural number, m^2). The entire stream may be the 
data an^ay or infomnation array made by n elementary 
streams in a bundle out of the transport stream(n: nat- 
ural number, 2^n<m), The entire stream of this type Is 
multiplexed-and-recorded on the infonnation recording 
medium by a unit of packet (e.g. a TS packet as de- 
scribed later), which is a physically accessible unit, by 
the information reproducing apparatus. Especially, the 
object data file is a logically accessible unit by the Infor- 
mation reproducing apparatus and stores the object da- 
ta constructed by a plurality of packets, each of which 
stores therein a piece of the picture information or the 
audio Infonnation. The reproduction sequence informa- 
tion file stores the reproduction sequence information 
(e.g. play list Infomnation), which defines the reproduc- 
tion sequence of the object data stored in this object da- 
ta file. The object infomnation file stores, as the repro- 
duction control information for controlling the reproduc- 
tion of the object data file by the infomnation reproducing 
apparatus, (^thecon-espondence definition information 
(e.g. an ES.Map Table indicating an elementary stream 
packet ID (ES.PID), as described later) and (ii) the re- 
lated group definition infonnation (e.g. AU information 
or an AU infonnation table as described later). Various 
Information stored In the object Infonnation file and the 
reproduction sequence infonnation file described above 
is not multiplexed by a unit of packet on the Information 
recording medium, which is different from the case of 
the object data file. Therefore, on the basis of the repro- 
duction control Information and the reproduction se- 
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quence information, it becomes possibie to reproduce 
the object data on the information reproducing appara- 
tus. Especially, in this case, in the infomnation reproduc- 
ing apparatus, it becomes possible to reproduce a de- 
sired show or program constructed by the combination 
of the picture information and the audio infomnation con- 
sisting of one portion of the entire stream which is mul- 
tiplexed and recorded on the information recording me- 
dium, on the basis of the correspondence relationship 
between a plurality of paclcets and a plurality of portion 
streams multiplexed on the time axis (e.g., at a same 
time point on the time axis of recording or reproducing 
a plurality of portion streams) and described In the cor- 
respondence definition information included in the re- 
production control Infomnation. Moreover, it is possible 
to relatively easily reproduce a desired one of a plurality 
of shows or programs, which are multiplexed and re- 
corded, by specifying a plurality of portion streams cor- 
responding this desired shows or programs (e.g. a pair 
of the video stream and the audio stream, a group ob- 
tained adding the sub picture stream to the above pair) 
on the basis of the related group (e.g. the AU as de- 
scribed later) which has a specific relation from among 
a plurality of series of contents constituting the plurality 
of portion streams and which is described in the related 
group definition infomnation included in the reproduction 
control infomnation. In addition, on the basis of this re- 
lated group, it becomes possible to easily recognize, at 
the information reproducing apparatus side, the related 
group having a specific relationship, such as multi-vision 
broadcasting, multi-view broadcasting, bilingual broad- 
casting, and bilingual caption broadcasting. 
[0011] Consequently, even if the content is compli- 
cate such that one show or program is constructed from 
a plurality of portion streams, it becomes possible to re- 
produce it without any problem according to the related 
group definition information on the infonnatlon recording 
medium, independently of a definition rule or an Inter- 
pretation rule (e.g. the contents of a PAT and a PMT as 
described later) which is packetized in the transport 
stream at the time of the transmission of these contents. 
Moreover, this type of record is perfomned not by apply- 
ing a change onto the data structure of such a transport 
stream that a plurality of TV channel shows or programs 
are digital-broadcasted at the same time, but by record- 
ing the object information file, the reproduction se- 
quence information file, and the like, in addition to the 
data structure, which is extremely useful in practice. 
[001 2] In one aspect of the infomnation recording me- 
dium of the present invention, the object infomnation file 
further stores, as the reproduction control infomnation, 
sub group definition infonmation which defines as a sub 
group a group of the plurality of portion streams mutually 
changeable by an infonmation reproduction apparatus 
In the related group. 

[001 3] According to this aspect, the object infonnation 
file stores the sub group definition infonnatlon (e.g. PU 
infonnatlon as described later) as one of the reproduc- 



tion control information to control the reproduction of the 
object data file by the information reproducing appara- 
tus. Therefore, on the basis of the sub group (e.g. the 
PU as described later) of the plurality of portion streams 

5 mutually changeable by the infomnation reproduction 
apparatus within the related group, It is possible to easily 
recognize the elementary stream, which can be freely 
switched over, within the related group having a specific 
relationship, such as multi-vision broadcasting, multl- 

10 view broadcasting, bilingual broadcasting, and bilingual 
caption broadcasting. 

[0014] In another aspect of the infonnation recording 
medium of the present Invention, the related group def- 
inition infonnation defines such that a same content may 
commonly belong to two or more groups, each of which 
is defined as the related group. 
[0015] According to this aspect, the same content can 
be commonly used between a plurality of related groups 
when reproducing, which helps to save a recording ca- 

20 pacity on the infonnation recording medium. 

[0016] In another aspect of the infonnation recording 
medium of the present invention, the sub group defini- 
tion information defines such that a same portion stream 
may commonly belong to two or more groups, each of 

25 which is defined as the sub group. 

[0017] According to this aspect, the same content can 
be commonly used between a plurality of sub groups 
when reproducing, which helps to save a recording ca- 
pacity on the infonnation recording medium. 

30 [0018] In another aspect of the information recording 
medium of the present invention, the entire stream in- 
cludes two or more portion streams each constructed 
by main picture Information which is the series of content 
as the picture information. 

35 [0019] According to this aspect, It Is possible to col- 
lectively record, by multiplexing and recording, the en- 
tire stream, such as the transport stream of the MPEG 
2, which includes two or more portion streams (i.e. the 
video stream) each constructed by video infonnation 

40 (main picture information), which is useful. 

[0020] In another aspect of the infonnation recording 
medium of the present invention, the entire stream In- 
cludes (i) the portion stream constructed by main picture 
information which is the series of content as the picture 

45 information and (ii) the portion stream constructed by 
sub picture infonnation which is the series of content as 
the picture information. 

[0021] According to this aspect, it is also possible to 
multiplex the portion stream (i.e. the sub picture stream) 

50 constructed by the sub picture information for adding 
subtitles, captions or the like, into the entire stream. In 
this case, it is also possible to con-elate a plurality of 
portion streams constmcted by a plurality of sub picture 
information, with one portion stream constructed by one 

55 video infonnation (main picture infomnation). 

[0022] In another aspect of the infonnation recording 
medium of the present invention, the entire stream is 
provided with at least one portion of a transport stream 
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of MPEG 2 and the related group definition information 
defines as tfie related group a group having a multi 
broadcasting relationship from among the plurality of se- 
ries of contents. 

[0023] According to this aspect, since the related 
group definition infomnation defines the related group 
having a multi broadcasting relationship by the transport 
stream, even if the multi broadcasting is collectively re- 
corded onto the information recording medium, it be- 
comes possible to appropriately reproduce the multi 
broadcasting on the basis of the related group informa- 
tion. 

[0024] In another aspect of the information recording 
medium of the present invention, the related group def- 
inition infonnation includes what defines as the related 
group the plurality of series of contents conresponding 
to one show constructed by a plurality of programs. 
[0025] According to this aspect, even in the case of 
defining, by a local rule such as a rule for each country, 
the plurality of series of contents coresponding to one 
show constructed by a plurality of programs as a group 
constituting the multi broadcasting or the lil<e, the repro- 
duction corresponding to the multi broadcasting or the 
like can be perfomried from the infonnation multiplexed 
and recorded on the information recording medium, on 
the basis of the related group information. 
[0026] Alternatively, in another aspect of the informa- 
tion recording medium of the present invention, the re- 
lated group definition information includes what defines 
as the related group the plurality of series of contents 
corresponding to one show constructed by one pro- 
gram. 

[0027] According to this aspect, even in the case of 
defining, by a local rule such as a rule for each country, 
the plurality of series of contents corresponding to one 
show constmcted by one program as a group constitut- 
ing the multi broadcasting or the lil^e, the reproduction 
corresponding to the multi broadcasting or the like can 
be perfomied from the infonnation multiplexed and re- 
corded on the infonnation recording medium; on the ba- 
sis of the related group infonnation. 
[0028] The above object of the present invention can 
be achieved by an infonnation recording apparatus for 
multiplexing and recording an entire stream by a unit of 
packet which is a physically accessible unit onto an in- 
formation recording medium, the entire stream including 
a plurality of portion streams each of which is provided 
with picture Information or audio infonnation constituting 
a series of content, the infonnation recording apparatus 
provided with: a first recording device for recording an 
object data file, the object data file storing object data, 
which is a logically accessible unit and is constructed by 
a plurality of packets, each of which stores therein a 
piece of the picture information or the audio infonnation; 
a second recording devtoe for recording a reproduction 
sequence infonnation file, the reproduction sequence 
information file storing reproduction sequence informa- 
tion which defines a reproduction sequence of the object 
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data stored in the object data file; and a third recording 
device for recording an object information file, the object 
information file storing, as reproduction control Informa- 
tion for controlling a reproduction of the object data file, 

5 (i) correspondence definition infonnation which defines 
a con^spondence relationship between a plurality of 
packets, which are multiplexed on a time axis, and the 
plurality of portion streams and (il) related group defini- 
tion information which defines as a related group a 

10 group having a specific relation from among a plurality 
of series of contents constituting the plurality of portion 
streams. 

[0029] According to the infonnation recording appa- 
ratus of the present invention, the object data file for 
IS storing the object data is recorded by the first recording 
device, such as a system controller, an encoder, a TS 
object generator as described later, and an optical pick- 
up or the like. The reproduction sequence Infonnation 
file for storing the reproduction sequence infonnation is 
recorded by the second recording device, such as a sys- 
tem controller and an optical pickup or the like. The ob- 
ject information file for storing the correspondence def- 
inition information and the related group definition infor- 
mation is recorded by the third recording device, such 
as a system controller and an optical pickup or the like, 
as the reproduction control infonnation. Therefore, It is 
possible to collectively multiplex and record the entire 
stream, such as at least one portion of the transport 
stream of the MPEG 2, onto the above-described infor- 
mation recording medium of the present invention. In 
this case, although the first recording device multiplexes 
and records the object data by a unit of packet, the sec- 
ond and third recording devices do not multiplex and 
record the reproduction sequence infonnation and the 
reproduction control infonnation by a unit of packet, re- 
spectively. 

[0030] Incidentally, the information recording appara- 
tus of the present invention can also employ various as- 
pects in response to various aspects of the above-de- 
scribed infonnation recording medium of the present in- 
vention. 

[0031] In one aspect of the information recording ap- 
paratus of the present invention, the entire stream is pro- 
vided with at least one portion of a transport stream of 
MPEG 2, which is digitally-transmitted and Is received 
at a set box. 

[0032] According to this aspect, the entire streams, 
such as at least one portion of the transport stream of 
the MPEG 2 (i.e. a portion conresponding to TV shows 
or TV programs of all channels or a plurality of chan- 
nels), which is digitally-transmitted and broadcasted, 
can be multiplexed and recorded onto the information 
recording medium in real time, which is extremely use- 
ful. 

[0033] The above object of the present invention can 
be achieved by an infonnation recording method of mul- 
tiplexing and recording an entire stream by a unit of 
packet which is a physically accessible unit onto an In- 
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formation recording medium, the entire stream including 
a plurality of portion streams each of which Is provided 
with picture information or audio information constituting 
a series of content, the information recording method 
provided with: a first recording process of recording an 
object data file, the object data file storing object data, 
which is a logically accessible unit and is constructed by 
a plurality of pacl<ets, each of which stores therein a 
piece of the picture information or the audio information; 
a second recording process of recording a reproduction 
sequence infomnation file, the reproduction sequence 
information file storing reproduction sequence infomna- 
tion which defines a reproduction sequence of the object 
data stored in the object data file; and a third recording 
process of recording an object Infonnatlon file, the ob- 
ject infomiation file storing, as reproduction control in- 
formation for controlling a reproduction of the object da- 
ta file, (i) correspondence definition infomnation which 
defines a correspondence relationship between a plu- 
rality of packets, which are multiplexed on a time axis, 
and the plurality of portion streams and (ii) related group 
definition information which defines as a related group 
a group having a specific relation from among a plurality 
of series of contents constituting the plurality of portion 
streams. 

[0034] According to the Infomnation recording method 

of the present invention, the object data file for storing 
the object data is recorded by the first recording proc- 
ess. The reproduction sequence information file for stor- 
ing the reproduction sequence Infomnation is recorded 
by the second recording process. The object Information 
file for storing the correspondence definition information 
and the related group definition information is recorded 
by the third recording process. Therefore, it is possible 
to collectively multiplex and record the entire stream, 
such as at least one portion of the transport stream of 
the MPEG 2, onto the above-described infomnation re- 
cording medium of the present invention. In this case, 
although the first recording process multiplexes and 
records the object data by a unit of packet, the second 
and third recording processes do not multiplex and 
record the reproduction sequence Infomnation and the 
reproduction control information by a unit of packet, re- 
spectively. 

[0035] Incidentally, the Infomnation recording method 
of the present invention can also employ various as- 
pects In response to various aspects of the above-de- 
scribed Infomnation recording medium of the present in- 
vention. 

[0036] In one aspect of the infomnation recording 
method of the present Invention, the entire stream Is pro- 
vided with at least one portion of a transport stream of 
MPEG 2, which is digitally-transmitted and is received 
at a set box. 

[0037] According to this aspect, the entire stream, 
such as at least one portion of the transport stream of 
the MPEG 2, which is digitally-transmitted and broad- 
casted, can be multiplexed and recorded onto the Infor- 



mation recording medium In real time, which is extreme- 
ly useful. 

[0038] The above object of the present invention can 
be achieved by an information reproducing apparatus 
s for reproducing one portion of the recorded entire 
stream from the above-described Infomnation recording 
medium of the present invention (including its various 
aspects), the infomnation reproducing apparatus provid- 
ed with: a reading device for physically reading the in- 
to formation from the Information recording medium; and 
a reproducing device for reproducing the object data In- 
cluded in the information read by the reading device, on 
the basis of the reproduction control infomnation and the 
reproduction sequence information Included in the infor- 
^5 mation read by the reading device. 

[0039] According to the Infonnatlon reproducing ap- 
paratus of the present invention. Information is physical- 
ly read by the reading device, such as an optical pickup 
and a demodulator or the like, from the Information re- 
20 cording medium by a unit of packet or the like. Then, the 
object data especially read by a unit of packet is repro- 
duced by the reproducing device, such as a system con- 
troller, a demultiplexer, and a decoder or the like, on the 
basis of the reproduction control information and the re- 
25 production sequence Infomnation Included in this read 
Information. Therefore, it is possible to appropriately re- 
produce, as a series of content infonnatlon, the informa- 
tion multiplexed and recorded on the above-described 
information recording medium of the present Invention. 
30 [0040] Incidentally, the infomnation reproducing appa- 
ratus of the present invention can also employ various 
aspects in response to various aspects of the above- 
described information recording medium of the present 
invention. 

35 [0041 ] The above object of the present invention can 
be achieved by an Infomnation reproducing method of 
reproducing one portion of the recorded entire stream 
from the above-described infomnation recording medi- 
um of the present invention (Including its various as- 

40 pects), the Information reproducing method provided 
with: a reading process of physically reading the infor- 
mation from the information recording medium; and a 
reproducing process of reproducing the object data in- 
cluded in the information read by the reading process, 

45 on the basis of the reproduction control infomnation and 
the reproduction sequence Information included in the 
information read by the reading process. 
[0042] According to the information reproducing 
method of the present Invention, Infomnation is physical- 

50 ly read by the reading process from the infomnation re- 
cording medium by a unit of packet or the like. Then, the 
object data especially read by a unit of packet is repro- 
duced by the reproducing process on the basis of the 
reproduction control Information and the reproduction 

55 sequence Information Included In this read information. 
Therefore, it Is possible to appropriately reproduce, as 
a series of content infomnation, the information multi- 
plexed and recorded on the above-described informa- 
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tion recording medium of the present invention. 
[0043] Incidentally, the Information reproducing meth- 
od of the present invention can also employ various as- 
pects in response to various aspects of the above-de- 
scribed information recording medium of the present in- 
vention. 

[0044] The above object of the present invention can 
be achieved by an infonnation recording and reproduc- 
ing apparatus for recording the entire stream onto and 
reproducing one portion of the recorded entire stream 
from the above-described information recording medi- 
um of the present invention (including its various as- 
pects), the infonnation recording and reproducing appa- 
ratus provided with: a first recording device for recording 
the object data file onto the infonnation recording medi- 
um; a second recording device for recording the repro- 
duction sequence Information file onto the information 
recording medium; a third recording device for recording 
the object infomnation file onto the infonnation recording 
medium; a reading device for physically reading the In- 
formation from the infomnation recording medium; and 
a reproducing device for reproducing the object data in- 
cluded in the information read by the reading device, on 
the basis of the reproduction control information and the 
reproduction sequence infonnation included in the Infor- 
mation read by the reading device. 
[0045] According to the information recording and re- 
producing apparatus of the present invention, as is the 
case of the above-described information recording ap- 
paratus of the present Invention, the object data file Is 
multiplexed and recorded by the first recording device 
by a unit of packet, the reproduction sequence informa- 
tion file is recorded by the second recording device, and 
the object infonnation file is recorded by the third record- 
ing device. Then, as is the case of the above-described 
infonnation reproducing apparatus of the present inven- 
tion, the Information is physically read by the reading 
device from the infonnation recording medium, and the 
object data especially read by a unit of packet is repro- 
duced by the reproducing device on the basis of the re- 
production control Infonnation and the reproduction se- 
quence information included In this read infonnation. 
Therefore, it is possible to collectively multiplex and 
record the entire stream, such as at least one portion of 
the transport stream of the MPEG 2, onto the above- 
described Infonnation recording medium of the present 
invention, and further it is possible to appropriately re- 
produce, as a series of content Infonnation, this multi- 
plexed-and-recorded infonnation. 
[0046] Incidentally, the Infonnation recording and re- 
producing apparatus of the present Invention can also 
employ various aspects in response to various aspects 
of the above-described infonnation recording medium 
of the present invention. 

[0047] The above object of the present Invention can 
be achieved by an infomnation recording and reproduc- 
ing method of recording the entire stream onto and re- 
producing one portion of the recorded entire stream 



from the above-described Information recording medi- 
um of the present Invention (including Its various as- 
pects), the information recording and reproducing meth- 
od provided with; a first recording process of recording 

5 the object data file onto the infonnation recording medi- 
um; a second recording process of recording the repro- 
duction sequence infomnation file onto the infonnation 
recording medium; a third recording process of record- 
ing the object information file onto the Information re- 

10 cording medium; a reading process of physk^ally read- 
ing the Infonnation from the information recording me- 
dium; and a reproducing process of reproducing the ob- 
ject data included in the information read by the reading 
process, on the basis of the reproduction control infor- 

15 matlon and the reproduction sequence information in- 
cluded in the infonnation read by the reading process. 
[0048] According to the infonnation recording and re- 
producing method of the present Invention, as is the 
case of the above-described information recording 

20 method of the present invention, the object data file Is 
multiplexed and recorded by the first recording process 
by a unit of packet, the reproduction sequence informa- 
tion file is recorded by the second recording process, 
and the object infonnation file Is recorded by the third 

25 recording process. Then, as is the case of the above- 
described information reproducing method of the 
present Invention, Information is physically read by the 
reading process from the information recording medi- 
um, and the object data especially read by a unit of pack- 

30 et is reproduced by the reproducing process on the ba- 
sis of the reproduction control Infonnation and the re- 
production sequence information included in this read 
information. Therefore, it is possible to collectively mul- 
tiplex and record the entire stream, such as at least one 

35 portion of the transport stream of the MPEG 2, onto the 
above-described Infomnation recording medium of the 
present invention, and further it is possible to appropri- 
ately reproduce, as a series of content Information, this 
muttiplexed-and-recorded infonnation. 

40 [0049] Incidentally, the Infonnation recording and re- 
producing method of the present invention can also em- 
ploy various aspects in response to various aspects of 
the above-described information recording medium of 
the present Invention. 

45 [0050] The above object of the present invention can 
be achieved by a computer program for controlling 
record which controls a computer provided in the above- 
described information recording apparatus of the 
present invention (including Its various aspects) and 

50 which causes the computer to function as at least one 
portion of the first recording device, the second record- 
ing device, and the third recording device. 
[0051 J According to the computer program for control- 
ling record of the present invention, the above described 

55 infomnation recording apparatus of the present invention 
can be relatively easily realized as a computer reads 
and executes the computer program from a program 
storage device, such as a ROM, a CD-ROM, a 
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DVD-ROM, and a hard disk or the like, or as It executes 
the computer program after downloading the program 
through a communication device. 
[0052] The above object of the present Invention can 
be achieved by a computer program for controlling re- 
production which controls a computer provided In the 
above-described infomnation reproducing apparatus of 
the present invention (including its various aspects) and 
which causes the computer to function as at least one 
portion of the reproducing device. 
[0053] According to the computer program for control- 
(ing reproduction of the present invention, the above de- 
scribed information reproducing apparatus of the 
present invention can be relatively easily realized as a 
computer reads and executes the computer program 
from a program storage device, such as a ROM, a 
CD-ROM, a DVD-ROM, and a hard disk or the like, or 
as it executes the computer program after downloading 
the program through a communication device. 
[0054] The above object of the present invention can 
be achieved by a computer program for controlling 
record and reproduction which controls a computer pro- 
vided in the above-described information recording and 
reproducing apparatus of the present invention (includ- 
ing Its various aspects) and which causes the computer 
to function as at least one portion of the first recording 
device, the second recording device, the third recording 
device, and the reproducing device. 
[0055] According to the computer program for control- 
ling record and reproduction of the present invention, 
the above described information recording and repro- 
ducing apparatus of the present invention can be rela- 
tively easily realized as a computer reads and executes 
the computer program from a program storage device, 
such as a ROM, a CD-ROM, a DVD-ROM, and a hard 
disk or the like, or as it executes the computer program 
after downloading the program through a communica- 
tion device. 

[0056] The above object of the present invention can 
be also achieved by a data structure in which an entire 
stream including a plurality of portion streams, each of 
which is provided with picture information or audio Infor- 
mation constituting a series of content, is multiplexed by 
a unit of packet, which is a physically accessible unit, 
provided with: an object data file for storing object data, 
which Is a logically accessible unit and is constructed by 
a plurality of packets, each of which stores therein a 
piece of the picture information or the audio infomnation; 
a reproduction sequence infonmatlon file for storing re- 
production sequence infonmatlon which defines a repro- 
duction sequence of the object data stored in the object 
data file; and an object information file for storing, as 
reproduction control Information for controlling a repro- 
duction of the object data file, (i) correspondence defi- 
nition Infomnation which defines a correspondence rela- 
tionship between a plurality of packets, which are mul- 
tiplexed on a time axis, and the plurality of portion 
streams and (ii) related group definition information 



which defines as a related group a group having a spe- 
cific relation from among a plurality of series of contents 
constituting the plurality of portion streams. 
[0057] According to the data stmcture of the present 

5 invention, as is the case of the Infomnation recording me- 
dium of the present invention, even if the content is com- 
plicate such that one show or program is constructed 
from a plurality of portion streams, it becomes possible 
to reproduce it without any problem according to the re- 

10 lated group definition infomnation, Independently of a 
definition rule or an interpretation rule (e.g. the contents 
of a PAT and a PMT as described later) which is pack- 
etlzed In the transport stream at the time of the trans- 
mission of these contents. 

15 [0058] These functions and other advantages of the 
invention will be apparent from the following description 
of embodiments. Ilowing description of embodiments. 



Brief Description of Drawings 

20 

[0059] 

FIG. 1 is a diagram showing a basic structure of an 
optical disc as being one embodiment of an infor- 
ms mation recording medium of the present invention, 
the upper part being a schematic plan view of the 
optical disc having a plurality of areas, the corre- 
sponding bottom part being an schematic diagram 
of the area structure in the radial direction; 
30 FiGs. 2 are a schematic diagram of the convention- 
al program stream of the MPEG 2 (FIG. 2(a)) and a 
schematic diagram of the transport stream of the 
MPEG 2 used In the embodiment (FIG. 2(b)); 
FIG. 3 is a schematic diagram showing a data struc- 
35 ture recorded on the optical disc in the embodiment; 
FIG. 4 is a schematic diagram showing details of 
the data structure in each object shown in FIG. 3; 
FIG. 5 is a schematic diagram showing that an ele- 
mentary stream for a program #1 at an upper level 
40 and an elementary stream for a program #2 at a 
middle level are multiplexed, constituting a trans- 
port stream for these two programs at a low level, 
with the horizontal axis as a time axis; 
FIG. 6 is a schematic diagram showing the image 
of TS packets multiplexed in one transport stream 
as a packet alignment along time; 
FIG. 7 is a schematic diagram showing the logical 
construction of data on the optical disc in the em- 
bodiment, focusing on the development of a logical 
so hierarchy to an object hierarchy or an entity hierar- 
chy; 

FIG. 8 is a schematic diagram showing two specific 
examples of the logical construction in a play list 
constituting one title shown in FIG. 7; 
ss FIG. 9 is a block diagram showing an infomnation 
recording / reproducing apparatus related to the 
embodiment of the present invention; 
FIG. 1 0 is a flow chart showing a record operation 
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(part 1) of the information recording / reproducing 
apparatus In the embodiment; 
FIG. 11 is a flow chart showing a record operation 
(part 2) of the information recording / reproducing 
apparatus in the embodiment; 
FIG. 12 is a flow chart showing a record operation 
(part 3) of the information recording / reproducing 
apparatus in the embodiment; 
FIG. 13 is a flow chart showing a record operation 
(part 4) of the information recording / reproducing 
apparatus in the embodiment; 
FIG. 14 is a flow chart showing a reproduction op- 
eration of the infonnation recording / reproducing 
apparatus in the embodiment; 
FIG. 15 is a schematic diagram showing an entire 
access flow in reproducing, in relation to the logical 
structure of the optical disc in the embodiment; 
FIG. 16 is a schematic diagram showing the data 
structures of IS objects #1 and #2 including a piu- 
rality of transport streams in one specific example 
of the embodiment; 

FIG. 17 is a schematic diagram showing the data 
structures of a PAT and a PMT of the TS object #1 
in one specific example of the embodiment; 
FIG. 18 is a schematic diagram showing the data 
structures of a PAT and a PMT of the TS object #2 
in one specific example of the embodiment; 
FIG. 19 is a schematic diagram showing the data 
structure of the TS object #3 in one specific example 
of the embodiment; 

FIG. 20 is a schematic diagram showing the data 
structures of a PAT and a PMT of the TS object #3 
in one specific example of the embodiment; 
FIG. 21 is a schematic diagram showing the data 
structure finally constructed on the optical disc in 
one specific example of the embodiment; 
FIG. 22 is a schematic diagram showing one spe- 
cific example of the data structure of a disc inf omia- 
tlon file in one specific example of the embodiment; 
FIG. 23 Is a schematic diagram showing one spe- 
cific example of the data structure of a title infomna- 
tion table included in the disc information file in one 
specific example of the embodiment; 
FIG. 24 is a schematic diagram showing one spe- 
cific example of the data structure of a play list in- 
formation table constructed In a play list information 
file in one specific example of the embodiment; and 
FIG. 25 is a schematic diagram showing one spe- 
cific example of the data structures of an AU table 
constructed in an object information file and an ES 
map table related to the AU table in one specific ex- 
ample of the embodiment. 

Best Mode for Carrying Out the Invention 

[0060] The best mode for carrying out the present in- 
vention will be hereinafter explained in order, for each 
embodiment with reference to the drawings. 



16 

(Information Recording Medium) 

[0061] The embodiment of an information recording 
medium of the present invention will be explained with 

5 reference to FIG. 1 to FIG. 8. In this embodiment, the 
intomiation recording medium of the present Invention 
is applied to an optical disc of a type capable of record- 
ing (writing) and reproducing (reading). 
[0062] Firstly, the basic structure of the optical disc in 

10 the embodiment will be explained with reference to FIG. 
1 . The upper part of FIG. 1 is a schematic plan view of 
the optical disc structure having a plurality of areas, and 
the bottom part is a schematic diagram of the area struc- 
ture in its radial direction 

15 [0063] As shown in FIG. 1 , an optical disc 100 is re- 
cordable in various receding methods, such as a mag- 
net-optical method and a phase transition method, onto 
which it is possible to record (write) infonnation a plural- 
ity of times or only once. It is provided with a lead-in area 

^0 104, a data record area 106, and a lead-out area 108 
on a recording surface on the disc main body, which is 
about 12 cm in diameter, as is the DVD, with a center 
hole 102 as the center, in the direction from the inner 
circumference to the outer circumference. In each area, 

25 groove tracks and land tracks are alternately placed spi- 
rally or coaxially with the center hole 1 02 as the center, 
for example. These groove tracks may be wobbled, and 
pre-pits may be fomied on either or both of the tracks. 
Incidentally, the present invention is not specially limited 

30 to an optical disc having these three areas. 

[0064] Secondly, the configuration of a transport 
stream (TS) recorded on the optical disc of the present 
invention will be explained with reference to FIG. 2(a) 
and FIG. 2(b). FIG. 2(a) is a schematic diagram showing 

35 the configuration of a conventional program stream of 
the MPEG 2, as a comparison. FIG. 2(b) is a schematic 
diagram showing the configuration of the transport 
stream (TS) of the MPEG 2. 

[0065] In FIG. 2(a), one program stream includes (i) 

40 only one video stream for video data as being the video 
information, and further (ii) at most 8 audio streams for 
audio data as being the audio information, and also (iii) 
at most 32 sub picture streams for sub picture data as 
being the sub picture infomnation, along a time axis t. 

45 Namely, the video data multiplexed at an arbitrary time 
tx is related to only the one video stream. For example, 
a plurality of video streams corresponding to a plurality 
of TV shows or movies cannot be included in the pro- 
gram stream at the same time. In order to multiplex the 

so TV show and the like accompanying pictures and trans- 
mit or record them, at least one video stream is required 
for each TV show and the like, so that the program 
stream fomnat in which only one video stream exists 
cannot allow the plurality of TV shows and the like to be 

55 transmitted or recorded after multiplexing them. 

[0066] In FIG. 2(b), one transport stream (TS) in- 
cludes (i) a plurality of video streams, as an elementary 
stream (ES) for the video data as being the video Infor- 
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mation, and further (ii) a plurality of audio streams, as 
an elementary stream (ES) for the audio data as being 
the audio information, and also (ili) a plurality of sub pic- 
ture streams, as an elementary stream (ES) for the sub 
picture data as being the sub picture infonnation. Name- 5 
ly, the video data multiplexed at an arbitrary time tx is 
related to the plurality of video streams. For example, 
the plurality of video streams corresponding to a plurality 
of TV shows or movies can be included in the transport 
stream at the same time. As described above, the trans- 10 
port stream fomnat whose transmission rate is high and 
in which there are the plurality of video streams can al- 
low the plurality of TV shows and the like to be transmit- 
ted or recorded after multiplexing them. However, digital 
broadcasting that employs an existing transport stream is 
does not transmit the sub picture stream. 
[0067] Incidentally, in FIG. 2(a) and FIG. 2(b). the vid- 
eo stream, the audio stream, and the sub picture stream 
are arranged in this order from up to down for explana- 
tory convenience; however, this order is not intended to 20 
correspond to an order of multiplexing them in units of 
a packet, as described later, or the like. In the transport 
stream, one combination, which is one video stream, 
two audio streams, and two sub picture streams, con- 
ceptually con-esponds to one show, for example. 2S 
The optical disc 1 00 in the embodiment described above 
is constructed to multiplex-and-record onto it the trans- 
port stream (TS) including a plurality of elementary 
streams (ES) in the above manner, to simultaneously 
record onto It the plurality of shows or programs. 30 
[0068] Next, a data structure recorded on the optical 
disc 100 will be explained with reference to FIG. 3 and 
FIG. 4. FIG. 3 IS a schematic diagram showing the data 
structure recorded on the optical disc 100. FIG. 4 is a 
schematic diagram showing details of the data structure 35 
in each object shown in FIG. 3. 
[0069] In the explanation below, a "title" is a reproduc- 
tion unit sequentially executing a plurality of "play lists", 
and is a logically large grouped unit, such as one movie 
and one TV show. The "play list" Is a file for storing in- 40 
formation necessary for the reproduction of an "object", 
and is provided with a plurality of "Items", each of which 
stores information about the reproduction range of the 
object to access the object. More specifically, "IN point 
inf omnation" Indicating a start address of the object and 
"OUT point infonnation" Indicating an end address of the 
object are written In each Item. Incidentally, these "IN 
point infonnation" and "OUT point information" may 
show the addresses directly, or show the addresses in- 
directly by showing a time length or a time point on a so 
reproduction time axis. The "object" is the entity infor- 
mation of a content constituting the transport stream of 
the MPEG 2 described above. 
[0070] In FIG. 3, the optical disc 1 00 is provided with 
the following four files as a logical structure: a disc In- ss 
fomiation file 110. a play (P) list infonnation file 120, an 
object infonnation file 130, and an object data file 140. 
It is further provided with a file system 105 to manage 
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those files. Incidentally, FIG. 3 does not directly show 
the physical data alignment on the optical disc 100, but 
it is possible to record with the arrangement order shown 
in FIG. 3 corresponding to the arrangement order shown 
in FIG. 1 . Namely, it is possible to record the file system 
105 or the like in the lead-in area 104, and then in the 
data record area 106, and further it is also possible to 
record the object data file 140 or the like in the data 
record area 1 06. Even if the lead-in area 1 04 and/or the 
lead-out area 108 shown In FIG. 1 do no exist, the file 
structure shown in FIG. 3 can be constaicted. 
[0071] The disc information file 11 0 is a file for storing 
comprehensive infonnation about the whole optical disc 
100, and It stores disc comprehensive infonnation 112, 
a title Information table 114, and other infonnation 118. 
The disc comprehensive information 1 12 stores the total 
number of titles and the like In the optical disc 1 00, for 
example. The title information table 1 14 stores, for each 
title, each title type (e.g. a sequential reproduction type, 
a branch type, and the like, as described later with ref- 
erence to FIG. 8) and a play (P) list number, which con- 
stitutes each title, as logical infonnation. 
[0072] The play list information file 120 Is a reproduc- 
tion sequence infomnatlon file. The play list infonnation 
file 1 20 stores a play (P) list Information table 121, which 
indicates the logical construction of each play list and 
which is separated Into play (P) list comprehensive in- 
formation 122, a play (P) list pointer 124, a plurality of 
play (P) lists 1 26 (P lists #1 to #n). and other Infonnation 
1 28. This play list information table 121 stores the logical 
information of each play list 126 in the order of the play 
list number. In other words, the storing order of each 
play list 126 is the play list number. Moreover, it is also 
possible to refer to the same play list 1 26 from a plurality 
of titles at the above described title Information table 
1 1 4. Namely, even In the case where a title #n and a title 
#m use the same play list #p, it is possible to construct 
such that the play list #p in the play list Information table 
121 is pointed at the title infonnation table 114. 
[0073] The object infonnation file 130 stores various 
attribute information about the storing position In the ob- 
ject data file 1 40 for each Item constituted in each play 
list 126 (i.e. a logical address that is a reproduction ob- 
ject) and about the reproduction of the Item. Especially, 
in this embodiment, the object Infonnation file 130 stores 
an AU (Associate Unit) table 131 including a plurality of 
AU infonnation 1321 (AU #1 to AU #n), as described later 
in detail, an ES (Elementary Stream) map table 1 34, and 
other Information 138. 

[0074] The object data file 1 40 stores a plurality of TS 
objects 142 (TS #1 object to TS #n object) for each 
transport streams (TS). Namely, It stores a plurality of 
entity data of the contents to be actually reproduced. 
[0075] Incidentally, the four files explained with refer- 
ence to FIG. 3 may be stored with each of them being 
separated Into a plurality of files, and all of them may be 
managed or administered by the file system 105. For 
example, the object data file 1 40 can be separated into 
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a plurality of data files, such as an object data file #1, 
an object data file #2, ... and the like. 
[0076] As shown in FIG. 4, the TS object 142 shown 
in FIG. 3, which Is a logically reproducible unit, is divided 
into a plurality of aligned units 1 43, each of which has 6 5 
kB data amount, for example. The head of the aligned 
units 143 corresponds to (or is "aligned" with) the head 
of the TS object 142. Each aligned unit 143 is further 
segmentized into a plurality of source packets 144, each 
of which has 1 92 B data amount. The source packet 1 44 io 
is a physically reproducible unit, and by using this unit, 
i.e. by a unit of packet, at least the video data, the audio 
data, and the sub picture data are multiplexed among 
the data on the optical disc 100. The other information 
may be also multiplexed in this manner. Each source is 
packet 144 Includes: control Information 145, which has 
4 B data amount, for controlling the reproduction, such 
as a packet arrival time stamp indicating a reproduction 
start time point (i.e. a time point of starting demultiplex* 
ing) of the TS (transport stream) packet on a reproduc- 20 
tlon time axis etc.; and a TS packet 1 46, which has 1 88B 
data amount. The TS packet 146 has a packet header 
1 46a at the head portion thereof. The video data is pack- 
etized to be a "video packet', the audio data is pack- 
etlzed to be an "audio packet", the sub picture data Is 2S 
packetized to be a "sub picture packet", orthe other data 
is packetized. 

[0077] Next, with reference to FIG. 5 and FIG. 6, It will 
be explained the multiple record of the video data, the 
audio data, the sub picture data, and the like, which are 30 
in the transport stream fomriat as shown in FIG. 2(b), on 
the optical disc 1 00 by the TS packet 1 46 shown in FIG. 
4. FIG. 5 is a schematic diagram showing that an ele- 
mentary stream (ES) for a program #1 (PG 1) at the up- 
per level in the figure and an elementary stream (ES) 35 
for a program #2 (PG 2) at the middle level in the figure 
are multiplexed, constituting a transport stream (TS) for 
these two programs (PG 1 & PG 2) at the lower level in 
the figure, with the horizontal axis as a time axis. FIG. 
6 is a schematic diagram showing the Image of TS pack- 40 
ets multiplexed In one transport stream (TS) as a packet 
alignment along time. 

[0078] As shown In FIG. 6, the TS packets 146 with 
the video data for the program #1 packetized are dis- 
cretely arranged with respect to the time axis in the el- 
ementary stream for the program #1 (the upper one), for 
example. The TS packets 146 with the video data for 
the program #2 packetized are discretely arranged with 
respect to the time axis in the elementary stream for the 
program #2 (the middle one), for example. Then, these so 
TS packets 146 are multiplexed, constructing the trans- 
port stream (the lower one) for those two programs. In- 
cidentally, this Is omitted in FIG. 5 for explanatory con- 
venience, but in fact, the elementary stream provided 
with the TS packets in which the audio data is pack- ss 
etized and the sub picture stream provided with the TS 
packets in which the sub picture data is packetized may 
be multiplexed as the elementary stream for the pro- 
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gram #1 in the same manner as shown in FIG. 2(b). 
Moreover, In addition to these, the elementary stream 
provided with the TS packets in which the audio data is 
packetized and the sub picture stream provided with the 
TS packets in which the sub pteture data is packetized 
may be multiplexed as the elementary stream for the 
program #2 in the same manner. 
[0079] As shown in FIG. 6, in this embodiment, one 
TS stream is constructed from many TS packets 146 
multiplexed as described above. Then, the many TS 
packets 146 in this multiplexed torn obtain the control 
information 145 such as the packet anrival time stamp 
orthe like, and are muitiplexed-and-recorded on the op- 
tical disc 1 00. incidentally, "Element (iOj)" is used In FIG. 
6 for the TS packet 146 comprising data which consti- 
tutes the program #1 (i = 1 , 2, 3), with j (j = 1 , 2, ...) as a 
number indicating the order for each stream which con- 
stitutes the program. This (iOj) is a packet ID, which is 
the identification number of the TS packet 146 for each 
elementary stream. A specific value is given to this pack- 
et ID between the plurality of TS packets 146 multi- 
plexed on the time axis (e.g., on the time axis of record- 
ing or reproducing a plurality of elementary streams) so 
that the plurality of TS packets 146 can be mutually dis- 
tinguished even if they are multiplexed on the time axis. 
[0080] In FIG. 6, a PAT (Program Associate Table) 
and a PI\/IT (Program Map Table) are also packetized in 
the unit of the TS packet 146 and are multiplexed. 
Among them, the PAT stores a table indicating a plurality 
of PMT packet IDs. Especially, with regard to the PAT, 
the MPEG 2 standard defines the addition of (000), as 
shown In FIG, 6, as a predetermined packet ID. Namely, 
it is constructed such that the TS packet 146 in which 
the PAT Is packetized is detected as the TS packet 146 
with its packet ID (000) from among many packets mul- 
tiplexed on the time axis. The PMT stores a table indi- 
cating the packet ID for each elementary stream consti- 
tuting each program with respect to one or a plurality of 
programs. To the PMT, an art3itrary packet ID may be 
added, but the packet ID of the PMT is indicated by the 
PAT detectable having the packet ID as (000), as de- 
scribed above. Therefore, the TS packets 146 in each 
of which the PMT is packetized (i.e. the TS packets 146 
with the packet IDs (1 00), (200). and (300) added in FIG. 
6) are detected by virtue of the PAT from among many 
packets multiplexed on the time axis. 
[0081] In the case where the transport stream is dig- 
ital-transmitted as shown in FIG. 6, the tuner can pick 
up the packets corresponding to the desired elementary 
stream from among the multiplexed packets by referring 
to the PAT and the PMT as constructed above, and de- 
modulate them. 

[0082] In this embodiment, the TS packet 146 stored 
in the TS object 142 shown In FIG. 4 Includes these PAT 
and PMT packets. Namely, when the transport stream 
shown in FIG. 6 is transmitted, it can be recorded onto 
the optical disc 1 00 as it is, which is a great advantage. 
[0083] Moreover, In this embodiment, the PAT and 
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PMT as recorded above are not referred to when repro- 
ducing the optical disc 100. Instead, referring to the AU 
table 131 and the ES map table 134, as shown in FIG. 
3 and as described later In detail, allows more effective 
reproduction, and also enables complicate multi-vision 5 
reproduction and the like to be treated with. On that ac- 
count, in this embodiment, the corresponding relation- 
ship between the elementary stream and the packet, 
which are obtained by referring to the PAT and the PMT 
when demodulating and recording, Is stored In the ob- io 
ject information file 130 in the fomri of the AU table 131 
and the ES map table 134 without packetizing nor mul- 
tiplexing. 

[0084] Next, the logical construction of the data on the 
optical disc 1 00 will be explained with reference to FIG. 
7 and FIG. 8. FIG. 7 is a schematic diagram showing 
the logical construction of the data on the optical disc 
100, focusing on the development of a logical hierarchy 
to an object hierarchy or an entity hierarchy. FIG. 8 is a 
schematic diagram showing two specific examples of 20 
the logical construction in the play (P) list constituting 
one title shown in FIG. 7. 

[0085] In FIG. 7. the optical disc 100 records one or 
a plurality of titles 200, each of which is a logically large 
unit, such as one movie or one TV show. Each title 200 25 
is logically constructed from one or a plurality of play 
lists 126. In each title 200, the plurality of play lists 1 26 
may have a sequential structure or a branch structure, 
whrch will be described later with reference to FIG. 8. 
Incidentally, In the case of a simple logical construction, 30 
one title 200 is constructed by one play list 126. More- 
over, one play list 126 can be referred to from the plu- 
rality of titles 200. 

[0086] Each play list 1 26 is logically constructed from 
a plurality of Items (i.e.. the play items) 204. In each play 35 
list 126, the plurality of Items 204 may have the sequen- 
tial structure orthe branch structure. Moreover, one item 
204 can be referred to from the plurality of play lists 1 26. 
The reproduction range of the TS object 1 42 is logically 
specified by the above described IN point Information 40 
and OUT point infomriation written in the Item 204. Then, 
by referring to object infomriation 130d with respect to 
the reproduction range logically specified, the reproduc- 
tion range of the TS object 142 is physically specified. 
Here, the object infomnatlon 130d includes various In- 
formation to reproduce the TS object 142. such as the 
attribute infomriation of the TS object 1 42 and EP (Entry 
Pass) map information 134d required for a data search 
in the TS object 1 42 (incidentally, the ES map table 1 34 
shown in FIG. 3 includes a plurality of such EP map In- so 
fomiation 134d). 

[0087] When reproducing the TS object 1 42 by an in- 
formation recording / reproducing apparatus, which will 
be described later, a physical address to be reproduced 
In the TS object 142 Is obtained from the Item 204 and S5 
the object information 130d, and the desired elementary 
stream is reproduced. 

[0088] In this embodiment, as described above, the 
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association from the logical hierarchy to the object hier- 
archy of the reproduction sequence is made by the IN 
point infonnation and the OUT point Infomriation de- 
scribed in the Item 204 and by the EP map infomnatlon 
134d described in the ES map table 134 (refer to FIG. 
3) of the object Infonmatlon 130d, which enables the el- 
ementary stream to be reproduced, 
[0089] Especially in this embodiment, the title 200 is 
classified broadly into two categories: "one play list type 
title" and "a plurality of play lists type title", and the latter 
is further categorized into what is constructed by a "se- 
quential play list" and what is constructed by a "branch 
play lisr. 

[0090] Among them, in the title 200 constructed by 
"the sequential play lisr. the play lists #1 , #2, and #3 
are sequentially reproduced by simply following the re- 
production time axis, as shown in the upper part of FIG. 
8. In this case, the reproduction order corresponds to 
the play list number, and therefore, all of the play list 
numbers are stored in the reproduction order in the per- 
tinent title #n information. 

[0091] On the other hand, in the title 200 constructed 
by 'Ihe branch play list", as shown in the lower part of 
FIG. 8, the play list #2 or #3 is selectively reproduced 
following the play list #1 . and further, the play list #4 or 
#5 is selectively reproduced following the play list #2. In 
this case, with regard to the reproduction order, the play 
list 126 to be reproduced next is determined by the 
branch condition when finishing the reproduction of the 
play lists 1 26 in the title. Therefore, the an'angement or- 
der of the play lists 126 in the title #n information does 
not correspond to the reproduction order. Only the play 
list 1 26 at the head position is specified. The branch con- 
dition is stored in the other areas. Because of this, it is 
possible to choose either of the play lists 126 by an au- 
dience's interactive operation, for example. 
[0092] Even in the any case of the titles shown in FIG. 
8, it is constmcted by one or more play lists 126. Espe- 
cially in this embodiment, it is possible to multiplex and 
to record a plurality of elementary streams in the unit of 
theTS packet 146. 

[0093] As described above, in this embodiment, the 
multiplexing and recording is perfonned on the optical 
disc 100 in units of theTS packet 146, and because of 
this, it is possible to muttlplex-and-record onto the opti- 
cal disc 100 the transport stream including many ele- 
mentary streams as shown in FIG. 2(b). According to 
this embodiment, in the case of recording digital broad- 
casting onto the optical disc 1 00, a plurality of shows or 
programs can be recorded at the same time within the 
limit of the record rate. Here, it employs a method of 
multiplexing the plurality of shows or programs and re- 
cording them into one TS object 142. The embodiment 
of an information recording / reproducing apparatus ex- 
ecutable this kind of record processing will be explained 
hereinafter. 
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(Information Recording / Reproducing Apparatus) 

[0094] Next, the embodiment of the infomiation re- 
cording / reproducing apparatus of the present invention 
will be explained with reference to FIG. 9 to FIG. 14. 5 
FIG. 9 is a block diagram of the infomnation recording / 
reproducing apparatus, and FIG. 10 to FIG. 14 are flow 
charts showing Its operation. 

[0095] In FIG. 9, an information recording / reproduc- 
ing apparatus 500 is classified broadly into a reproduc- io 
tion system and a record system, can record Infomriation 
onto the optical disc 100 described above, and can re- 
produce the infomriation recorded on this. In this embod- 
iment, the infonmation recording / reproducing appara- 
tus 500 is for recording and reproducing as described is 
above, but it is possible to construct an embodiment of 
the recording apparatus of the present Invention from 
the record system part of the infonnatlon recording / re- 
producing apparatus 500. On the other hand, it is pos- 
sible to construct an embodiment of the reproducing ap- 20 
paratus of the present invention from the reproduction 
system part of the Information recording / reproducing 
apparatus 500. 

[0096] The infomriation recording / reproducing appa- 
ratus 500 is provided with: an optical pickup 502; a servo 25 
unit 503; a spindle motor 504; a demodulator 506; a de- 
multiplexer 508; a video decoder 511 ; an audio decoder 
512; a sub picture decoder 513; an adder 51 4; a system 
controller 520; a memory 530; a modulator 606; a for- 
matter 608; a TS object generator 61 0; a video encoder 30 
611; an audio encoder 612; and a sub picture encoder 
613. The system controller 520 is provided with a file 
system / logical structure data generator 521 ; and a file 
system / logical structure data interpret device 522. 
Moreover, the memory 530 and a user interface 720 for 3s 
the user Input of the title infomnation and the like are 
connected to the system controller 520. 
[0097] Among these constitutional elements, the de- 
modulator 506, the demultiplexer 508, the video decod- 
er 511 , the audio decoder 512, the sub picture decoder 40 
51 3, and the adder 51 4 constitute the reproduction sys- 
tem, mostly. On the other hand, among these constitu- 
tional elements, the modulator 606, the formatter 608, 
the TS object generator 61 0. the video encoder 611 , the 
audio encoder 612, and the sub picture encoder 613 
constitute the record system, mostly. The optical pickup 
502, the servo unit 503, the spindle motor 504, the sys- 
tem controller 520, the memory 530, and the user inter- 
face 720 for the user input of the title information and 
the like are shared for both the reproduction system and so 
the record system, mostly. Moreover, a TS object data 
source 700, a video data source 711, an audio data 
source 712, and a sub picture source 713 are prepared 
for the record system. The file system / logical structure 
data generator 521 installed in the system controller 520 ss 
Is mainly used in the record system, and the file system 
/ logical structure data Interpret device 522 is mainly 
used in the reproduction system. The optical pickup 502 
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irradiates a light beam LB, such as a laser beam, onto 
the optical disc 1 00 with a first power as a reading light 
when reproducing, and with a second power as a writing 
light when recording while modulating It. The servo unit 
503 is controlled by a control signal Scl outputted from 
the system controller 520 when reproducing and record- 
ing, and it performs a focus servo, a tracking servo, and 
the tike at the optical pickup 502. as well as performing 
a spindle servo at the spindle motor 504. The spindle 
motor 504 is constructed to spin the optical disc 1 00 at 
a predetemnined speed while receiving the spindle ser- 
vo by the servo unit 503. 

(i) Configuration and Operation in Record System 

[0098] Next, the specific configuration and operation 

of each constitutional element constituting the record 
system in the information recording / reproducing appa- 
ratus 500 w[ill be explained case by case, with reference 
to FIG, 9 to FIG. 13. 

(i-1) The case of using the already prepared TS object 

[0099] This case-will be explained with reference to 
FIG. 9 and FIG. 10. 

[0100] In FIG. 9, the TS object data source 700 is pro- 
vided with a record storage, such as a video tape and a 
memory, and it stores TS object data D1 . 
[0101] In FIG. 10, firstly, the infomriation about each 
title (e.g. the configuration content of a program list and 
the like) logically constructed on the optical disc 1 00 us- 
ing the TS object data D1 is inputted from the user In- 
terface 720 to the system controller 520, as a user Input 
12 of the title infomriation and the like. Then, the system 
controller 520 takes in the user input 12 of the title infor- 
mation and the like obtained from the user interface 720 
(step S21 : Yes and step S22). in this case, the user in- 
terface 720 is controlled by a control signal Sc4 from the 
system controller 520, and it can perfonm input process- 
ing according to the content to be recorded, such as 
choosing through a title menu screen. Incidentally, in the 
case where the user input has been already performed 
or the like (step S21 : No), this processing is omitted. 
[01 02] Then, the TS object data source 700 is control- 
led by a control signal ScB giving an Instruction for read- 
ing out the data from the system controller 520, and out- 
puts the TS object data D1 . Then, the system controller 
520 takes in the TS object data D1 from the TS object 
source 700 (step S23), and perfomns the analysis of the 
data an^ay of the TS object data D1 (e.g. a record data 
length and the like), the analysis of each elementary 
stream configuration (e.g. understanding of ES_PiD (El- 
ementary Stream • Packet Identification number) as de- 
scribed later), and the like, by virtue of a TS analysis 
function of the file system / logical structure data gener- 
ator 521 , for example, on the basis of the PAT, the PMT, 
and the like packetized as well as the video data and 
the like as described above (step S24). 
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[0103] Then, the system controller 520 prepares the 
disc Inf onnation file 1 1 0, the play list Infomiatlon file 1 20, 
the object information file 130, and the file system 105 
(refer to FIG. 3), as logical infomiatlon file data D4, by 
virtue of the file system / logical structure data generator 5 
521 , from the user input 12 of the taken-ln title Informa- 
tion and the like and from the analysis results of the data 
array of the TS object data D1 and each elementary 
stream (step S25). The memory 530 is used when pre- 
paring the logical infomriation file data D4 described io 
above. 

[0104] Incidentally, such a variation that the data 
about the data array of the TS object data D1 , the data 
about the construction Infomriation of each elementary 
stream, and the like are prepared in advance, is appar- is 
ently and variously conceivable. Such a variation is also 
within the scope of the embodiment. 
[0105] In FIG. 9, the formatter 608 is a device for per- 
forming a data an-ay format to store onto the optical disc 
100 the TS object data D1 and the logical infomriation 20 
file data D4. More specifically, the fomiatter 608 is pro- 
vided with a switch Sw1 and a switch Sw2 and Is switch- 
ing-controlled by a switch control signal Sc5 from the 
system controller 520. When formatting the TS object 
data D1, it connects the switch Swi to a0 side and ss 
the switch Sw2 to the 0 side so as to output the TS 
object data D1 from the TS object data source 700. In- 
cidentally, the transmission control of the TS object data 
D1 is perfomned by the control signal Sc8 from the sys- 
tem controller 520. On the other hand, when fomnatting 30 
the logical infonmation file data D4, the formatter 608 is 
switching-controlled by the switch control signal Sc5 
from the system controller 520, and connects the switch 
Sw2 to a® side so as output the logical infomfiation file 
data D4. 35 
[0106] In a step S26 in FIG. 10. (i) the logical infomria- 
tion file data D4 from the file system / logical structure 
data generator 521 in the step S25 or (ii) the TS object 
data D1 from the TS object data source 700 is outputted 
th rough the f onnatter 608 by the switch in g-control by the 40 
fomriatter 608 as constructed above (step S26). 
[0107] The selection output from the formatter 608 is 
transmitted to the modulator 606 as disc image data D5, 
Is modulated by the modulator 606, and is recorded onto 
the optical disc 1 00 through the optical pickup 502 (step 45 
S27). The system controller 520 also executes the disc 
record control in this case. 

[0108] Then, if both the logical information file data 
D4 generated in the step S25 and the corresponding TS 
object data D2 have not been completely recorded yet, so 
the operational flow returns to the step S26, continuing 
to the record (step S28: No). Incidentally, there is no 
preference in the record order of the logical information 
file data D4 and the corresponding TS object data D2. 
[0109] On the other hand, if the both have been ai- 55 
ready recorded, it is judged whether or not the record 
on the optical disc 100 is supposed to be ended, on the 
basis of the presence or absence of an end command 



(step S29). if not supposed to be ended (step S29: No), 
the operational flow returns to the step S21 , continuing 
the record processing. On the other hand, if supposed 
to be ended (step S29: Yes), a series of record process- 
ing ends. 

[01 1 0] As described above, the infomriation recording 
/ reproducing apparatus 500 perfonns the record 
processing in the case of using the already prepared TS 
object. 

[0111] Incidentally, the example in FIG. 10 shows that 
the logical information file data D4 and the correspond- 
ing TS object data D2 are outputted in the step S26, after 
preparing the logical infonnation file data D4 in the step 
S25. However, it is also possible to execute the output 
of the TS object data D2 and/or the record of the TS 
object data D2 onto the optical disc 1 00 before the step 
S25, and after or in parallel with this recording, it is pos- 
sible to generate and record the logical information file 
data D4. 

(i-2) The case of receiving and recording the transport 
stream on air 

[0112] This case will be explained with reference to 
FIG. 9 and FIG. 11. Incidentally. In FIG. 11, the same 
steps as those in FIG. 1 0 have the same step reference 
numbers, and their explanation will be omitted as occa- 
sion demands. 

[0113] Again, in this case, the similar processing is 
performed, as is "the case of using the already prepared 
TS object" described above. Therefore, focusing on the 
differences from this case, the explanation will be done 
hereinafter. 

[0114] In the case of receiving and recording the 
transport stream on air, or the transport stream being 
broadcasted, the TS object data source 700 Is provided 
with a receiver (set top box) for receiving the digital 
broadcast on air, for example, receives the TS object 
data D1 , and transmits it to the formatter 608 in real time 
(step S41). At the same time, reception Infomriation D3 
(i.e. infomriation corresponding to the data transmitted 
through the receiver and the interface of the system con- 
troller 520) including the program construction informa- 
tion and the ES.PID information, as described later, 
which are deciphered upon receiving Is taken Into the 
system controller 520 and is stored into the memory 530 
(step S44). 

[0115] In the meantime, the TS object data D1 output- 
ted to the formatter 608 is outputted to the modulator 
606 by the switching-control of the fomriatter 608 (step 

542) , and Is recorded onto the optical disc 100 (step 

543) . 

[0116] Along with these operations, using the pro- 
gram construction infomriation and the ES_PID Infomria- 
tion Included In the reception Infonnation D3 taken-ln- 
upon receiving and stored in the memory 530, the file 
system / logical structure data generator 521 prepares 
the logical infonmation file data D4 (step S24 and step 
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S25). Then, after completing the record of a series of 
the IS object data D1 , this logical infonmatlon file data 
D4 is additionally recorded onto the optical disc 100 
(step S46 and step S47). Incidentally, these step S24 
and step S25 may be perf omned after the step S43. 
[0117] Moreover, as the occasion demands (e.g. in 
the case of editing one portion of the title, or the like), 
by adding the user input 12 of the title infomiation and 
the like from the user interface 720 to the program con- 
struction infomiation and the ES„PID information stored 
in the memory 530, It is possible to prepare the logical 
infonnation file data D4 by the system controller 520 and 
additionally record this onto the optical disc 100. 
[01 1 8] As described above, the infonnation recording 
/reproducing apparatus 500 performs the record 
processing in the case of receiving the transport stream 
on air and recording it in real time. 
[0119] Incidentally, if all the reception data obtained 
when broadcasting is once stored into an archive appa- 
ratus, and then, if this is used as the TS object source 
700. the same processing as that In "the case of using 
the already prepared TS object" will do. 

(i-3) The case of recording the video data, the audio 
data, and the sub picture data 

[0120] This case will be explained with reference to 
FIG. 9 and FIG. 12. Incidentally, in FIG. 12, the same 
steps as those In FIG. 1 0 have the same step reference 
numbers, and their explanation will be omitted as occa- 
sion demands. 

[01 21] In the case of recording the video data, the au- 
dio data, and the sub picture data, which are individually 
prepared in advance, the video data source 71 1 , the au- 
dio data source 712, and the sub pteture data source 
713 are individually provided with the record storage, 
such as a video tape and a memory, and store a video 
data DV, an audio data DA, and a sub picture data DS, 
respectively. 

[01 22] These data sources are controlled by the con- 
trol signal Sc8 giving an instruction for reading out the 
data from the system controller 520, and they transmit 
the video data DV, the audio data DA, and the sub pic- 
ture data DS, to the video encoder 611, the audio en- 
coder 61 2, and the sub picture encoder 61 3, respective- 
ly (step S61). Then, the video encoder 611, the audio 
encoder 612, and the sub picture encoder 613 execute 
a predetermined type of encode processing (step S62). 
[01 23] The TS object generator 61 0 Is controlled by a 
control signal Sc6 from the system controller 520 and 
converts the data encoded In this manner to the TS ob- 
ject data constituting the transport stream (step S63). In 
this case, the data array infonnation of each TS object 
data (e.g. a record data length and the like) and the con- 
struction infonnation of each elementary stream (e.g. 
the ES_PID, as described later, and the like) are trans- 
mitted from the TS object generator 610 as information 
16 to the system controller 520 and are stored Into the 
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memory 530 (step S66). 

[0124] On the other hand, the TS object data gener- 
ated by the TS object generator 61 0 is transmitted to the 
(D side of the switch Swi of the fonnatter 608. Namely, 

5 when fonnatting the TS object data from the TS object 
generator 610, the formatter 608 is switching-controlled 
by the switch control signal Sc5 from the system con- 
troller 520 to change the switch Swi to ihe® side and 
the switch Sw2 to the® side, thereby outputting the TS 

10 object data (step S64). Then, this TS object data Is re- 
corded onto the optical disc 100 through the modulator 
606 (step S65). 

[0125] Along with these operations, using the data ar- 
ray infonnation of each TS object data and the construc- 
ts tion information of each elementary stream taken Into 
the memory 530 as the infonnation 1 6, the file system / 
logical structure data generator 521 prepares the logical 
information file data D4 (step S24 and step S25), Then, 
after completing the record of a series of the TS object 
20 data D1 , this is additionally recorded onto the optical 
disc 100 (step S67 and step S68). Incidentally, the step 
S24 and the step S25 may be processed after the step 
S65. 

[0126] Moreover, as the occasion demands (e.g. In 
25 the case of editing one portion of the title), by adding the 
user input 12 such as the title infonnation and the like 
form the user interface 720 onto these infonnation 
stored In the memory 530, It is possible to prepare the 
logical Infonnation file data D4 with the file system / log- 
30 leal structure generator 521 and additionally record this 
onto the optical disc 1 00. 

[0127] As described above, the Information recording 
/ reproducing apparatus 500 perfomns the record 
processing in the case of the recording the video data, 
35 the audio data, and the sub picture data, which are in- 
dividually prepared In advance. 
[0128] Incidentally, this record processing is applica- 
ble even when recording an arbitrary content the user 
has. 

40 

(i-4) The case of recording the data by authoring 

[0129] This case will be explained with reference to 
FIG. 9 and FIG. 13. Incidentally, in FIG. 13, the same 
^5 steps as those in FIG. 1 0 have the same step reference 
numbers, and their explanation will be omitted as occa- 
sion demands. 

[01 30] In this case, by combining the above described 
three types of record processing In the three cases, an 

50 authoring system generates the TS object, the logical 
Information file data, and the like in advance (step S81 ), 
and then completes the processing of switching-control 
perfonned at the formatter 608 (step S82). Then, the in- 
formation obtained by this operation is transmitted to the 

55 modulator 606 equipped In front of and/or behind an 
original disc cutting machine, as the disc image data D5 
(step S83), and this cutting machine prepares the orig- 
inal disc (step S84). 
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(ii) Configuration and Operation in Reproduction 

System 

[0131] Next, the specific configuration and operation 
of each constitutional element constituting the reproduc- 
tion system in the infomnation recording / reproducing 

apparatus 500 will be explained with reference to FIG. 
9 and FIG. 14. 

[01 32] The user interface 720 inputs the title to be re- 
produced, its reproduction condition, and the like to the 
system controller 520 as the user Input 12 of the title in- 
formation and the like. In this case, the user interface 
720 is controlled by the control signal Sc4 from the sys- 
tem controller 520, and it can perfomn the input process- 
ing according to the content to be reproduced, such as 
choosing through a title menu screen. 
[0133] Responding to this, the system controller 520 
controls the disc reproduction with respect to the optical 
disc 1 00, and the optical pickup 502 transmits a reading 
signal S7 to the demodulator 506. 
[01 34] The demodulator 506 demodulates a recorded 
signal recorded on the optical disc 1 00 from this reading 
signal S7, and outputs It as demodulated data D8. The 
logical infonnation file data (i.e. the file system 105, the 
disc infonnation file 110, the P list infomnation file 120, 
and the object infonnation file 130, shown In FIG. 3) in- 
cluded in this demodulated data D8 as being a not-mul- 
tiplexed infonnation part is supplied to the system con- 
troller 520. On the basis of this logical infonnation file 
data, the system controller 520 executes various repro- 
duction control, such as processing of detemnining a re- 
production address and controlling the optical pickup 
502. 

[0135] On the other hand, as for the TS object data 
included in the demodulated data D8 as being a multi- 
plexed infonnation part, the demultiplxer 508 is control- 
led by a control signal Sc2 from the system controller 
520 to demultiplex the TS object data. Here, the control 
signal Sc2 is transmitted so as to start demultiplexing 
when completing an access to a reproduction position 
address by the reproduction control of the system con- 
troller 520. 

[01 36] The demultiplexer 508 transmits and supplies 
the video packet, the audio packet, and the sub picture 
packet, to the video decoder 511, the audio decoder 
512, and the sub picture decoder 513, respectively. 
Then, the video data DV, the audio data DA, and the sub 
picture data DS are respectively decoded. 
Incidentally, the packets Included in the transport 
stream, in each of which the PAT or the PMT is pack- 
etlzed as shown in FIG. 6, are respectively included as 
a part of the demodulated data 08; however, they are 
discarded or abandoned at the demultiplexer 508. 
[01 37] The adder 51 4 is controlled by a control signal 
Sc3 giving an Instruction of the mixing from the system 
controller 520, and mixes or superimposes in a prede- 
termined timing the video data DV and the sub picture 
data DS, which are respectively decoded at the vide de- 
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coder 511 and the sub pbture decoder 513. The result 
is outputted as a video output from the infonnation re- 
cording / reproducing apparatus 500 to a TV monitor, for 
example. 

5 [01 38] On the other hand, the audio data OA decoded 
at the audio decoder 51 2 is outputted as an audio output 
from the Infomnation recording / reproducing apparatus 
500 to an external speaker, for example. 
[0139] Here, the specific example of a reproduction 
10 processing routine by the system controller 520 will be 
explained with reference to FIG. 14. 
[0140] In FIG. 14, assume that as an initial condition, 
the recognition of the optical disc 1 00 in the reproduction 
system and the recognition of a volume structure and a 
IS file structure by the file system 1 05 (refer to FIG . 3) have 
been already completed by the system controller 520 
and the file system / logical structure data interpret de- 
vice 522 inside the system controller 520. Here, it will 
be explained the operational flow after obtaining the to- 
tal number of the total titles from the disc comprehensive 
infonnation 112 in the disc Information file 110 and then 
choosing or selecting one title from among them. 
[0141 ] Firstly, the choice or selection of the title is per- 
fomned at the user interface 720 (step S1 1 ), and the sys- 
tem controller 520 obtains the infonnation about the re- 
production sequence from a reading result of the file 
system / logical structure data interpret device 522. 
More specifically, it obtains the Infonnation indicating 
the process play list structure of the logical hierarchy 
and the infonnation of Item or Items constituting the 
process play list structure (refer to FIG. 7) (step SI 2). 
By this, a reproduction object is determined (step SI 3). 
[01 42] Then , the object Information file 1 30 related to 
the TS object as being the reproduction object is ob- 
tained. Especially in the embodiment, the AU infomna- 
tion 1321 and PU (Presentation Unit) infonnation 3021, 
which will be described later, are also obtained as the 
information stored In the object information file 1 30 (step 
SI 4). These obtained Infonnation allow the association 
or correlation of the above described logical hierarchy 
and the object hierarchy (refer to FIG. 7). 
[0143] Then, on the basis of the Information obtained 
in the step S14, the object to be reproduced and the re- 
production address are detemnined (step S1 5), and then 
the processing of the object hierarchy Is started; namely, 
the actual reproduction Is started (step SI 6). 
[0144] While reproducing, it Is monitored whether or 
not the command-input of a "scene change" corre- 
sponding to the change of the PU 302 in the AU 132 
based on the PU information 3021 and the AU informa- 
tion 1321, as described later is performed (step SI 7). If 
the "scene change" is command-inputted (step SI 7: 
Yes), the operational flow retums to the step S15, and 
the processes from the step SI 5 to the step SI 7 are 
repeatedly executed. On the other hand. If the "scene 
change" Is not command-inputted (step SI 7: No), the 
presence or the absence of the command input Indica- 
tive of ending the reproduction processing is judged 
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(step S18). If there is not the command input indicating 
of ending (step S1 8: No), the operational flow retums to 
the step S11 , and the processes inform the step S11 to 
the step S18 are repeatedly executed. On the other 
hand, if there Is the command input indicative of ending 
(step SI 8: Yes), a series of the reproduction processing 
ends. 

(Access Flow in reproducing) 

[0145] Next, the flow of the access in reproducing at 
the information recording / reproducing apparatus 500, 
which uses the AU information 1321 and the PU infor- 
mation 3021, as one of the features of this embodiment, 
will be explained as well as the logical structure of the 
optical disc 100. FIG. 15 is a schematic diagram show- 
ing an entire flow of the access in reproducing, In relation 
to the logical structure of the optical disc 100. 
[0146] In FIG. 15, the logical structure of the optical 
disc 100 Is categorized broadly into the following three 
hierarchies: a logical hierarchy 401 ; an object hierarchy 
403; and a logic-object associating hierarchy 402 mutu- 
ally associating those two hierarchies. 
[0147] Among them, the logical hierarchy 401 is a hi- 
erarchy that logically specifies various logical infonma- 
tion to reproduce the desired title when reproducing, as 
well as the play list to be reproduced and its construction 
content. In the logical hierarchy 401 , disc information 
110d indicating the entire titles 200 and the like on the 
optical disc 100 Is written within the disc Information file 
110 (referto FIG. 3), and further, reproduction sequence 
infomriation 120d of the entire contents on the optical 
disc 1 00 Is written within the play list information file 1 20 
(refer to FIG. 3). More specifically, the constmction of 
one or a plurality of play lists 126 is written in each title 
200 as the reproduction sequence Infomnation 120d, 
and the construction of one or a plurality of Items 204 is 
written in each play list 126. Then, in accessing at the 
time of the reproduction, the logical hierarchy 401 as de- 
scribed above specifies the title 200 to be reproduced, 
the play list 126 con^esponding to this, and further the 
Item 204 con'esponding to this. 
[0148] Then, the logic-object associating hierarchy 
402 Is a hierarchy that specifies the attribute and the 
physical storing address of the TS object data 140d to 
be reproduced, so as to specify the combination and/or 
the construction of the TS object data 1 40d as being the 
entity data and perfomi an address conversion to the 
object hierarchy 403 from the logical hierarchy 401 , on 
the basis of the infonmation specified in the logical hier- 
archy 401 as described above. More specifically, In the 
logic-object associating hierarchy 402, the object Infor- 
mation data 130d, which separates a group of the con- 
tents constituting each Item 204 into the units of the AU 
132 and which finely separates each AU 132 Into the 
units of the PU 302, is written in the object Infomriation 
file 130 (referto FIG. 3). 

[0149] Here, "the PU (Presentation Unit) 302" is one 



example of "a sub group" in the present invention, and 
is a unit of associating and grouping a plurality of ele- 
mentary streams in the unit of changing the reproduc- 
tion. For example, as is the title #1 in the specific exam- 

s pies shown later in FIG. 1 6 to FIG. 22, the PU 302 is a 
unit of grouping the elementary stream packet ID 
(ES_PID) and the like for each vision of a "multi-vision 
title". If there are three audio streams in this PU 302, the 
user can also freely change three audio (e.g. audio in 

10 different languages and the like) while reproducing this 
vision. 

[0150] On the other hand, "the AU (Associate Unit) 
132" is a unit of associating or grouping a plurality of 
elementary streams, such as the video stream, in the 

IS TS object used In one title, and is a group of one or a 
plurality of PUs 302. More specifically, the AU 132 Is a 
unit of grouping the elementary stream packet ID 
(ES_PID) for each TS object, indirectly through the PU 
302. This AU 132 corresponds to a group of a plurality 

20 of shows or programs mutually having a special rela- 
tionship considering the contents, for example, a plural- 
ity of shows or programs mutually changeable in multi- 
ple broadcasting and the like. Then, the PU 302 corre- 
sponds to a group of one or a plurality of elementary 

25 streams, which belong to the same AU 132 and which 
constitute a plurality of shows or programs mutually 
changeable by the user operation when reproducing. 
[0151] Therefore, if the AU 132 to be reproduced is 
specified, and moreover, the PU 302 is specified, then 

30 the elementary stream to be reproduced is specified. 
Namely, even If not using the PAT nor the PMT shown 
in FIG. 6, it becomes possible to reproduce the desired 
elementary stream from among the multiplexed and re- 
corded elementary streams from the optical disc 100. 

35 [01 52] The more specific data structure of the AU in- 
fomriation 1321 and the PU Infomriation 3021, which re- 
spectively define the AU 1 32 and the PU 302 described 
above, will be explained later with reference to FIG. 26. 
[0153] Here, the elementary stream that is actually re- 

40 produced is Identified or specified by the ES_PID, which 
is the packet ID of the elementary stream (refer to FIG. 
6), from the PU information 3021. At the same time, by 
converting the information indicating the starting time 
and the ending time of the reproduction to the address 

<5 information of the elementary stream, the content In a 
specific area (or specific time range) of a specific ele- 
mentary stream is reproduced. 
[0154] In this manner, in the logic-object associating 
hierarchy 402, the address conversion to the physical 

50 address related to each PU 302 from the logical address 
related to each Item 204 is executed. 
[0155] Then, the object hierarchy 403 Is a physical hi- 
erarchy to reproduce the actual TS object data 1 40d. In 
the object hierarchy 403, theTS object data 140d is writ- 

55 ten within the object data file 1 40 (refer to FIG. 3). More 
specifically, the TS packets 146 constituting a plurality 
of elementary streams (ES) are multiplexed at each time 
point, and the arrangement of the TS packets 1 46 along 



17 



EP 1 469 677 A1 



34 



33 

the time axis enables a plurality of elementary streams 
to be constructed (refer to FIG. 5). Then, the plurality of 
TS packets 146 multiplexed at each time point are as- 
sociated with the PU 302 identified at the logic-object 
associating hierarchy 402, for each elementary stream. 5 
Incidentally, it is also possible to associate a plurality of 
PUs 302 with one elementary stream (e.g. to share the 
elementary stream related to the same audio data and/ 
or the elementary stream related to the same sub picture 
data, among a plurality of changeable shows or pro- io 
grams). 

[0156] In this manner, in the object hierarchy 403, the 
actual object data is reproduced using the physical ad- 
dress obtained by the conversion at the logic-object as- 
sociating hierarchy 402. 15 
[0157] As described above, the three hierarchies 
shown in FIG. 15 allow the execution of the access with 
respect to the optical disc 100 in reproducing. 

(Specific Example of Data Structure Recorded on 20 
Optical Disc) 

[0158] Next, with reference to FIG. 16 to FIG, 21. the 
data structure on the optical disc 1 00 on which the AU 
(Associate Unit) Infomiation and the PU (Presentation 25 
Unit) information, as one of the features of this embod- 
iment, are recorded will be explained, in addition to the 
PAT (Program Association Table) and the PMT (Pro- 
gram Map Table), as one of the features of the transport 
stream. 30 
[0159] In this specific example, it will be explained the 
data structure constructed on the optical disc 1 00 in the 
case of constructing two titles within the optical disc 1 00 
with respect to the object provided with the three TS ob- 
jects #1 , #2, and #3. FIG. 1 6 is a schematic diagram 35 
showing the data structures of TS objects #1 and #2 In- 
cluding a plurality of elementary streams in this specific 
example. FIG. 17 is a schematic diagram showing the 
data structures of the PAT and the PMT of the TS object 
#1 in this specific example. FIG. 18 is a schematic dia- <o 
gram showing the data structures of a PAT and a PMT 
of the TS object #2 In this specific. FIG. 19 is a schematic 
diagram showing the data structure of the TS object #3 
in this specific example. FIG. 20 is a schematic diagram 
showing the data structures of a PAT and a PMT of the 45 
TS object #3 in this specific example. FIG. 21 is a sche- 
matic diagram showing the data structure finally con- 
structed on the optical disc 100 in this specific example. 
[0160] Firstly, as shown in FIG. 1 6, the title #1 Is con- 
structed by using the TS #1 object and the TS #2 object 50 
as they are, with the transport stream that is used in dig- 
ital broadcasting as those two TS objects 142 (refer to 
FIG. 3). The "show 1" in FIG. 16 is the binary broadcast- 
ing which uses two programs, whose program map 
packet IDs ("Program Map PIDs") are "100" and "200" 55 
that have program numbers ("Program No" In FIG. 16) 
"1" and "2", respectively On the other hand, the "show 
2" in FIG. 1 6 is nomial broadcasting which uses one pro- 



gram, whose program map packet ID is "300" that has 
a program number "3". For example, the elementary 
stream (ES) corresponding to the program whose pro- 
gram number is "1" is "Video 1 (video stream 1)", "Audio 
1 (audio stream 1)", and "Audio 2 (audio stream 2)". 
Their elementary stream packet IDs (ES_PID) are 
"101", "102", and "103", respectively (refer to FIG. 6). 
The other contents of the elementary stream (ES) and 
the packet ID (ES_PID) are as shown in FIG. 16. 
[0161] In this specific example as shown in FIG. 17, 
the TS #1 object is constructed such that one PAT can 
specify three PMTs and that each PMT can specify each 
TS packet of the elementary stream to be reproduced, 
with respect to the PAT and the PMT at the time of broad- 
casting. 

[0162] More specifically, the packet ID (PID) of the 
PAT is set to a defined value such as "000", and because 
of this, it is possible to firstly specify or determine the 
PAT from among many packets (refer to FIG. 6) multi- 
plexed each time point. Moreover, referring to the con- 
tents of the specified PAT, It Is possible to specify the 
PMTs from among many packets (refer to FIG. 6) mul- 
tiplexed each time point by use of the packet ID of the 
PMT for the " Program 1" (e.g. "100"), the packet ID of 
the PMT for the " Program 2" (e.g. "200"), or the packet 
ID of the PMT for the " Program 3" (e.g. "300"). 
[0163] Moreover, referring to the contents of the PMT 
as specified above can specify the TS packet whose 
content to be reproduced is packetized, from among 
many packets multiplexed each time point (refer to FIG. 
6). For example, in the case where the PMT for the "pro- 
gram 1 " is specified, It is possible to specify the TS pack- 
et by use of the packet ID of the TS packet for the "video 
stream 1" (e.g. "101"), the packet ID of the TS packet 
for the "audio stream 1" (e.g. "102"), or the packet ID of 
the TS packet for the "audio stream 2" (e.g. "103"). 
Moreover, as is the case where the PMT for the "pro- 
gram 2" and the PMT for the "program 3" are specified, 
the TS packet to be reproduced can be specified. 
[0164] Especially, in this specific example, a group of 
data constituting a series of transport streams used for 
broadcasting (e.g. a sequentially broadcasted unit with- 
out CM (commercial) and the like) is treated as the "TS 
object" (refer to FIG. 3). Here, it is assumed that, firstly 
at the time of broadcasting, two shows are transmitted 
by using the TS #1 object as three programs, the "show 
2" ends as time elapses, and after a commercial, the 
"show 1" is broadcasted by using the TS #2 object. 
Therefore, Its program sequence is changed in the mid- 
dle. 

[0165] Furthemnore, in this specific example as 
shown in FIG. 18, theTS #2 object is constructed such 
that two PMTs can be specified by one PAT and that 
each TS packet of the elementary stream to be repro- 
duced can be specified by each PMT. with respect to the 
PAT and the PMT at the time of broadcasting. 
[0166] As shown in FIG. 15 to FIG. 18, In this specific 
example, one title #1 is constituted by the TS #1 object 
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and the TS #2 object as they are at the time of broad- 
casting, in which the ChA contents are omitted. 
[0167] Moreover, as shown in FIG. 19, the title #2 is 
constructed by using the TS #3 object in this specific 
example. The authoring operation is applied onto this 
TS object #3 so as to preliminarily store the TS object 
#3 as ROM contents. The TS object #3 is provided with 
the eiementary streams for the video data and for the 
audio data, and especially, two elementary streams for 
the sub picture data (i.e. "Sub picture 1" and "Sub pic* 
ture 2" as the contents of the ES in FIG. 1 9). 
[0168] In this specific example, as shown in FIG. 20, 
the TS #3 object constituting the title 2 has the simply 
constructed PAT and PMT 

[0169] FiG. 21 shows the summary of the data struc- 
ture constructed on the optical disc 1 00, which has been 
explained with reference to FIG. 15 to FIG. 20. 
[0170] In FIG. 21, the data structure where the two 
titles are composed of three TS objects is constructed 
on the optical disc 100. Especially, the "show 1", which 
is binary-broadcasted, is logically reconstructed on the 
optical disc 100 as the title of a "multi vision" type (I.e. 
the type with which a user can freely change to watch) 
similar to the "angle change" of the DVD. In this change, 
this title does not use the audio stream "Audio 1" of the 
TS #1 object or the audio stream "Audio 6" of the TS #2 
object, and further it does not use the elementary stream 
of the "show 2". 

(Each Infonnation File Structure) 

[0171] Next, with reference to FiG, 22 to FiG. 25. var- 
ious infonnation files constructed on the optical disc 1 00 
in the embodiment, i.e. the data structures of (1 ) the disc 
infonnation file 110, (2) the play list infonnation file 120, 
(3) the object infonnation file 1 30, and (4) the object data 
file 140, which have been explained with reference to 
FIG. 3, will be explained using their own specific exam- 
ples. 

(1) Disc Information File: 

[0172] Firstly, with reference to FIG. 22 and FIG. 23, 
the disc infonnation file 110 will be explained in detail 
using one specific example. FIG. 22 is a schematic di- 
agram showing one specific example of the data struc- 
ture of the disc information file 110. FIG. 23 is a sche- 
matic diagram showing one specific example of the data 
structure of the title information table 1 1 4 included in the 
disc Information file 110. 

[0173] In this specific example as shown in FiG. 22, 

the disc information file 1 1 0 stores therein the disc com- 
prehensive infonnation 112, the title Information table 
114, and the other infonnation 118. 
[01 74] Among them , the disc comprehensive informa- 
tion 1 12 is comprehensive information, such as disc vol- 
ume information indicating the serial number of one se- 
ries constructed by a plurality of optical discs 100, total 
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title number infonnation and so on. 
[0175] The title Infonnation table 114 stores therein 
the entire play lists constituting each title and the other 
information, e.g. Information for each title, such aschap- 

5 ter information within the title and the like, and includes 
title pointer information, title #1 infonnation, title #2 In- 
fonnation, and so on. Here, the "title pointer information" 
is the storing address infomnation of the title #n infonna- 
tion, i.e. the storing address information indicating the 

10 storing position of the title #n infonnation in the title in- 
fonnation table 1 1 4, as the correspondence relationship 
is Indicated with arrows in FIG. 22, and the "title pointer 
information" is written with a relative logical address. 
Then, this information of the number of titles In the op- 

15 tical disc 1 00 is arranged in the order of the titles as the 
relative logical address. Incidentally, the data amount of 
each storing address infonnation may be a fixed byte or 
a changeable byte. 

[0176] The other infomnation 11 8 is infonnation about 
20 each title, such as the title type, for example, the se- 
quential type, the branch type, and the like, which have 
been already explained with reference to FIG. 8, and the 
total number of play lists. 

[0177] Incidentally, in the specific example shown in 
25 FIG. 16 to FIG. 21, the both titles are individually con- 
structed by simply one play list title. Therefore, in the 
case of this specific example, the title infonnation table 
114 stored in the disc information file 110 shown in FIG. 
22 is written as a table having relatively simple contents 
30 as shown in FIG. 23. 

(2) Play List Information File: 

[0178] Next, with reference to FIG. 24, the play list In- 

35 formation file 120 will be explained in detail using one 
specific example. FIG. 24 is a schematic diagram show- 
ing one specific example of the data structure on the 
play list information table 1 21 constructed in the play list 
information file 120. 

^ [0179] In this specific example, as shown in FIG. 24, 
the play list infonnation file 120 stores therein play list 
comprehensive Infonnation 122, a play list pointer table 
124, and a play list #1 infomnation table and a play list 
#2 information table 126, for each Field type, as the play 
list infomnation table 121 (refer to FIG. 3). 
[0180] Each Field may have a structure that allows the 
necessary number of each table to be added. For ex- 
ample, if there are four play lists, the relative Field may 
increase to four Fields under this structure, and so does 

50 the Item information table. 

[0181] Among them, the play list comprehensive In- 
formation (P list comprehensive infonnation) 122 de- 
scribes therein the size of the play list table, the total 
number of play lists, and the like. 

55 [01 82] The play list pointer table (P list pointer table) 
124 stores therein the address of each play list written 
position as being the relative logical address in the play 
list infomnation table 126, as the conespondence rela- 
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tionship is indicated with arrows in FIG. 24. 
[0183] The play list #1 infomiation table (P list #1 In- 
formation table) 126 stores therein comprehensive in- 
formation about the play list #1 , the Item information ta- 
ble of the play list #1 (P list Item information table) and 
the other infomriation. The play list #2 infonnation table 
126 also stores therein the same type of information re- 
lated to the play list #2. 

[01 84] The "Item information table" stores therein the 
Item Information of the total number of Items constituting 
one program list. Here, an AU number in the AU (Asso- 
ciate Unit) table written in the "Item #1 (ltem#1 informa- 
tion)" or the "Item #2 (Item #2 infomriation)" is the 
number of the AU, which stores infomiatlon for specify- 
ing the address of the TS object to be used for the Item 
reproduction, or specifying each elementary stream (i. 
e. the video stream, the audio stream, or the sub picture 
stream) in the TS object to be used for the Item repro- 
duction. 

(3) Object infomriation file: 

[0185] Next, with reference to FIG. 25, the object in- 
formation file 130 will be explained in detail using one 
specific example. FIG. 25 is a schematic diagram show- 
ing one specific example of the data structures on the 
AU table 131 (refer to FIG. 3) constructed in the object 
infonnation file 130 and on the ES map table 134 (refer 
to FIG. 3) related to the AU table 131 . 
[0186] In this specific example, as shown in FIG. 25, 
the object infonnation file 130 stores therein object In- 
formation tables. The object infomriation tables com- 
prise the AU table 131 shown in the upper part of FIG. 
25 and the ES map table 1 34 shown in the lower part. 
[0187] In the upper part of FIG. 25, the AU table 131 
may have a structure that allow the necessary number 
of tables for each Field to be added. For example, if 
there are four AUs, the relative Field may increase to 
four Fields under this structure. 
[0188] The AU table 131 stores therein "AU table 
comprehensive Infonnation" In which the number of AUs 
and the pointer to each AU, and the like are written, and 
"the other infonnation." 

[0189] The AU table 131 describes therein the Index 
number (Index number = ...) of the con^esponding ES 
map table 134, as the AU information 1 321 indicating an 
EStablelndex#m in each PU#m corresponding to each 
AU #n. Here, the "AU" is a unit corresponding to a 
"show" in TV broadcast, for example, as mentioned 
above (especially, in the case of "multi-vision" broad- 
casting, it is a unit of a group of a plurality of "visions" 
which are changeable or selectable), and it includes one 
or more PUs, each of which is a reproduction unit. More- 
over, the "PU" is a group of mutually changeable ele- 
mentary streams which are included in each AU, as de- 
scribed above, and the ES table Index #m correspond- 
ing to each PU is specified by the PU information 3021. 
For example, in the case of constructing multi-view con- 
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tents with the AU, the AU stores therein a plurality of 
PUs, and each PU stores therein the pointers to a plu- 
rality of elementary stream packet IDs, which indicate 
the packets constituting the content of each view. This 
5 indicates the Index number in the ES map table 1 34, as 
described later. 

[0190] In the lower part of FIG. 25, the ES map table 
134 stores therein ES map table comprehensive infor- 
mation, a plurality of Indexes #m (m=1, 2, ...), and the 

10 " other infonnation", for each Field. 

[0191] The "ES map table comprehensive infonna- 
tion" describes therein the size of the ES map table, the 
total number of Indexes, and the like. 
[0192] The "Index #m" includes the elementary 

IS stream packet IDs (ES.PIDs) of the entire elementary 
streams to be used for the reproduction, the correspond- 
ing Index numbers, and the address infonnation of the 
elementary stream. 

[0193] Constructed as described above, it is possible 
20 to obtain the elementary stream packet ID (ES_PID) of 
the actual elementary stream from the Index number of 
the ES map 1 34 specified from the AU table 1 31 . More- 
over, since the address information of the elementary 
stream con^esponding to the elementary stream packet 
25 ID can be obtained at the same time, It Is possible to 
reproduce the object data on the basis of these infonna- 
tion. 

[0194] According to the data structure of the optical 
disc 100 explained above, even in the case of adding a 

30 new title to the optical disc 1 00, necessary information 
can be added easily, which is useful. On the other hand, 
even if some infonnation becomes unnecessary as a re- 
sult of editing or the like, for example, what is to be done 
is simply not to refer to the infonnation, and it is not nec- 

35 essary to actually delete the information from the table, 
which Is useful, as well. 

[0195] Incidentally, in FIG. 25, even the ES^PID that 
is not referred to from the AU table 1 31 in the upper part 
is described by the Index of the ES map table 1 34 in the 

40 lower part; however, it is not necessary to describe the 
ES_PID that is not referred to. In this manner If the more 
versatile ES map table 134 is prepared In advance by 
describing the ES_PID that is not referred to in this man- 
ner, it Is not necessary to reconstruct the ES map table 

45 in the case of reedlting the content, such as trying the 
authoring operation again, which Is advantageous. 

(4) Object Data File: 

so [0196] Next, the object data file 140 will be explained. 
[01 97] In this specific embodiment, the object data file 
140 stores therein three TS objects as the object data 
that are actual reproduction objects. 
[0198] The transport stream defined by the PAT and 
ss the PMT described above can be stored as they are or 
after some processes, as explained with reference to 
FIG. 9, and the infonmation that specifies the elementary 
stream as being the reproduction object in the transport 
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stream is stored in the above described object informa- 
tion file 130 (refer to FIG. 25). The elementary stream 
is associated with the entity data in the object data file 
140 by the object information file 130. 
[0199] As explained in detail with reference to FIG. 1 
to FIG. 25, according to the embodiment, even if the TS 
objects 142 are prepared on the basis of different PAT 
and PMT constmction rules, as is a local rule that differs 
from country to country, and even if the entity data of the 
TS objects 142 is stored on the optical disc 100 as it is, 
without changing the structures of the TS objects 142, 
It is possible to reproduce the infomriation by using the 
AU information 1321 and the PU infonnation 3021, with- 
out any problem. 

[0200] According to the embodiment, it is possible to 
logically and easily construct the title 200 by the entire 
data or the one portion of data of the TS object 142 (e. 
g. the "show 1 " only, or further, a certain time band where 
the "show 1 " of the TS #1 object 1 42 exists and the like 
as shown with the above described one specific exam- 
ple) or by the title 200 reproduced by connecting a plu- 
rality of TS objects 142, which is useful. In addition, by 
constructing the AU 1 32, which is a group of the relative 
elementary streams related to the above, as well as di- 
rectly pointing out the elementary stream packet ID 
(ES_PID) by each AU 132, it is possible to easily repro- 
duce the infonnation regardless of the definition con- 
tents of the PAT and the PMT of the TS object 142 (i.e. 
without analyzing the TS object 142 on the basis of the 
definition rule or the interpretation rule in the infonnation 
reproducing apparatus or a player), which is prepared 
in a different broadcast method (which is based on the 
local rules of Japan and foreign countries). In other 
words, when storing the transport stream onto the opti- 
cal disc 100, it Is not necessary to reconstruct the PAT 
and the PMT. As described above, even in the case of 
recording onto the same optical disc 100 a plurality of 
TS objects 142, whose PAT and PMT reconstruction 
rules are not standardized, it is possible to reproduce 
the multi-vision or multi-view show or program from the 
transport stream stored on the optical disc 100 without 
any problem (i.e. freely and appropriately according to 
a user's desire in the changeable or selectable condition 
of the vision or the view), which is extremely useful in 
practice. Therefore, It is possible to easily ensure the 
interchangeability of the reproduction with a relatively 
simple player construction. 

[0201] Moreover, according to the embodiment, by 
constructing the PU 302 structure in each AU 132, a 
group of the mutually related elementary streams (e.g. 
the video stream, the audio stream, and the like) is easily 
judged at the time of changing the reproduction scenes 
of the multi-vision title and the like, and the change func- 
tion of the audio stream In one vision and the like can 
be realized relatively simply 

[0202] According to the embodiment, even in the case 
of adding a new elementary stream, such as the sub 
picture stream, to the already prepared TS object 142, 



It is possible to reconstruct a simple stream that only 
multiplexes the entire data, by additionally describing 
the elementary stream packet ID of the simply new ele- 
mentary stream, the PAT, the PMT, and the like, without 
5 changing the elementary stream packet ID (ES.PID) of 
the existing definition. As described above, the logical 
structure of the optical disc 100 in the embodiment can 
simplify the authoring operation for preparing a ROM ti- 
tle, as well as being broadly available for even a house- 
10 hold recorder and the like. 

[0203] In addition, according to the embodiment, 
since the AU information 1321 and the PU information 
3021 need maintenance only when editing the contents 
(i.e. it is not necessary to rewrite the PAT and the PMT), 
IS it is possible to edit without considering about the PAT 
or the PMT as being materials, which is extremely use- 
ful. 

[0204] Incidentally, the optical disc 1 00 as one exam- 
ple of the infonnation recording medium and a recorder 
or a player related to the optical disc 1 00 as one example 
of the infonnation recording/ reproducing apparatus are 
explained In the above described embodiment; howev- 
er, the present invention is not limited to the optical disc, 
and the recorder or the player. The present invention is 
available for the other various Infonnation recording / 
reproducing media corresponding to the high density re- 
cording or the high transmission rate, and their record- 
ers or players, 

[0205] According to this embodiment, as described 
above in detail, it Is possible to multiplex and record a 
plurality of shows or programs, which are transmitted in 
the transport stream orthe like, onto the information re- 
cording medium, such as an optical disc, and relatively 
simply reproduce a desired one from among them. In 
addition, it becomes possible to easily recognize, at the 
information reproducing apparatus side, the elementary 
stream orthe like having a specific relationship, such as 
multi-vision broadcasting, multi-view broadcasting, bi- 
lingual broadcasting, and bilingual caption broadcast- 
ing. 

[0206] The present invention is not limited to the 
above-described embodiments, and changes may be 
made if desired without departing from the scope or spir- 
it of the invention which can be read from the claims and 
the entire specification. An infonnation recording medi- 
um, an apparatus for and a method of recording the In- 
formation, an apparatus for and a method of reproduc- 
ing the information, an apparatus for and a method of 
recording and reproducing the infomnation, a computer 
program for controlling the record or the reproduction, 
and a data structure including a control signal that ac- 
company such changes are also intended to be within 
the technical scope of the present Invention. 



[0207] An infonnation recording medium, a apparatus 
for and a method of recording the infonnation, an appa- 
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ratus for and a method of reproducing the Information, 
an apparatus for and a method of recording and repro- 
ducing the infonnation, a computer program for control- 
ling the record or the reproduction, and a data structure 
Including a control signal that are associated with the 
present invention can be applied to a high-density opti- 
cal disc for consumer or industrial use, such as a DVD, 
on which various Information, such as the video Infor- 
mation, the audio information, the sub picture Informa- 
tion, and the reproduction control Infonmation, can be 
recorded at high density and further can be applied to a 
DVD player, a DVD recorder, and the like. Moreover, 
they can be applied to an infonnation recording medium, 
an infonnation recording /reproducing apparatus, orthe 
like, which are Inserted in or can be connected to various 
computer equipment for consumer or industrial use, for 
example. 



Claims 

1, An information recording medium on which an en- 
tire stream including a plurality of portion streams, 
each of which comprises picture Information or au- 
dio infonnation constituting a series of content, is 
multlplexed-and-recorded by a unit of packet, which 
is a physically accessible unit, said infonnation re- 
cording medium comprising: 

an object data file for storing object data, which 
is a logically accessible unit and is constructed 
by a plurality of packets, each of which stores 
therein a piece of the picture information or the 
audio Infonnation; 

a reproduction sequence infonnation file for 
storing reproduction sequence infonnation 
which defines a reproduction sequence of the 
object data stored in said object data file; and 
an object Infonnation file for storing, as repro- 
duction control infonnation for controlling a re- 
production of said object data file, (i) corre- 
spondence definition information which defines 
a correspondence relationship between a plu- 
rality of packets, which are multiplexed on a 
time axis, and the plurality of portion streams 
and (ii) related group definition infonnation 
which defines as a related group a group having 
a specific relation from among a plurality of se- 
ries of contents constituting the plurality of por- 
tion streams. 

2. The information recording medium according to 
claim 1, wherein said object Infonnation file further 
stores, as the reproduction control Infonnation, sub 
group definition Infonnation which defines as a sub 
group a group of the plurality of portion streams mu- 
tually changeable by an information reproduction 
apparatus In the related group. 
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3. The infonnation recording medium according to 
claim 1 or 2, wherein the related group definition In- 
fonnation defines such that a same content may 
commonly belong to two or more groups, each of 

5 which is defined as the related group. 

4. The infonnation recording medium according to 
claim 2, wherein the sub group definition informa- 
tion defines such that a same portion stream may 

10 commonly belong to two or more groups, each of 
which is defined as the sub group. 

5. The infonnation recording medium according to 
claim 1 or 2, wherein the entire stream includes two 

'5 or more portion streams each constructed by main 
picture information which is the series of content as 
the picture information. 

6. The infonnation recording medium according to 
20 claim 1 or 2, wherein the entire stream Includes (i) 

the portion stream constructed by main picture in- 
formation which is the series of content as the pic- 
ture infonnation and (ii) the portion stream con- 
structed by sub pk:ture Information which is the se- 
25 ries of content as the picture information. 

7. The infonnation recording medium according to 
claim 1 or 2, wherein 

the entire stream comprises at least one por- 
30 tion of a transport stream of MPEG 2 and 

the related group definition Infomnatton de- 
fines as the related group a group having a mufti 
broadcasting relationship from among the plurality 
of series of contents. 

35 

8. The infonnation recording medium according to 
claim 1 or 2, wherein the related group definition in- 
fonnation includes what defines as the related 
group the plurality of series of contents correspond- 

40 ing to one show constructed by a plurality of pro- 
grams. 

9. The infonnation recording medium according to 
claim 1 or 2, wherein the related group definition in- 

4s fonnation includes what defines as the related 
group the plurality of series of contents correspond- 
ing to one show constructed by one program. 

10. An Information recording apparatus for multiplexing 
so and recording an entire stream by a unit of packet 

which is a physically accessible unit onto an infor- 
mation recording medium, said entire stream In- 
cluding a plurality of portion streams each of which 
comprises picture information or audio infonnation 
ss constituting a series of content, said Infonnation re- 
cording apparatus comprising: 

a first recording device for recording an object 
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data file, said object data file storing object da- 
ta, which is a logically accessible unit and is 
constaicted by a plurality of packets, each of 
which stores therein a piece of the picture in- 
formation or the audio Information; s 
a second recording device for recording a re- 
production sequence infonnation file, said re- 
production sequence infonnation file storing re- 
production sequence information which defines 
a reproduction sequence of the object data 10 
stored In said object data file; and 
a third recording device for recording an object 
Infonnation file, said object Information file stor- 
ing, as reproduction control information for con- 
trolling a reproduction of said object data file, is 
(i) correspondence definition Infonnation which 
defines a correspondence relationship be- 
tween a plurality of packets, which are multi- 
plexed on a time axis, and the plurality of por- 
tion streams and (11) related group definition in- 20 
fonnatlon which defines as a related group a 
group having a specific relation from among a 
plurality of series of contents constituting the 
plurality of portion streams. 

25 

11. The information recording apparatus according to 
claim 10, wherein the entire stream comprises at 
least one portion of a transport stream of MPEG 2, 
which is digitally-transmitted and Is received at a set 
box. 30 

12. An infonnation recording method of multiplexing 
and recording an entire stream by a unit of packet 
which is a physically accessible unit onto an infor- 
mation recording medium, said entire stream in- 35 
eluding a plurality of portion streams each of which 
comprises picture information or audio information 
constituting a series of content, said infonnation re- 
cording method comprising: 

40 

a first recording process of recording an object 
data file, said object data file storing object da- 
ta, which is a logically accessible unit and is 
constructed by a plurality of packets, each of 
which stores therein a piece of the picture in- 45 
fonnatlon or the audio infonnation; 
a second recording process of recording a re- 
production sequence information file, said re- 
production sequence infonnation file storing re- 
production sequence infonnation which defines so 
a reproduction sequence of the object data 
stored in said object data file; and 
a third recording process of recording an object 
Infonnation file, said object information file stor- 
ing, as reproduction control Infonnation for con- S5 
trolling a reproduction of said object data file, 
(i) correspondence definition Infonnation which 
defines a correspondence relationship be- 
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tween a plurality of packets, which are multi- 
plexed on a time axis, and the plurality of por- 
tion streams and (11) related group definition in- 
formation which defines as a related group a 
group having a specific relation from among a 
plurality of series of contents constituting the 
plurality of portion streams. 

13. The information recording method according to 
claim 12, wherein the entire stream comprises at 
least one portion of a transport stream of MPEG 2, 
which is digitally-transmitted and is received at a set 
box. 

14. An Information reproducing apparatus for reproduc- 
ing one portion of the recorded entire stream from 
said information recording medium according to 
claim 1 or 2, 

said infonnation reproducing apparatus com- 
prising: 

a reading device for physically reading the in- 
formation from the information recording medi- 
um; and 

a reproducing device for reproducing the object 
data included in the information read by said 
reading device, on the basis of the reproduction 
control information and the reproduction se- 
quence information included in the infonnation 
read by said reading device. 

15. An infonnation reproducing method of reproducing 
one portion of the recorded entire stream from said 
Infonnation recording medium according to claim 1 
or 2, 

said information reproducing method com- 
prising: 

a reading process of physically reading the in- 
formation from the Infonnation recording medi- 
um; and 

a reproducing process of reproducing the ob- 
ject data included in the information read by 
said reading process, on the basis of the repro- 
duction control Information and the reproduc- 
tion sequence information Included in the infor- 
mation read by said reading process. 

16. An Infonnation recording and reproducing appara- 
tus for recording the entire stream onto and repro- 
ducing one portion of the recorded entire stream 
from said infonnation recording medium according 
to claim 1 or 2, 

said infonnation recording and reproducing 
apparatus comprising: 

a first recording device for recording the object 
data file onto the information recording medl- 
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um; 

a second recording device for recording the re- 
production sequence information file onto the 
Infomriation recording medium; 
a third recording device for recording the object s 
Infomnatlon file onto the infomriation recording 
medium; 

a reading device for physically reading the in- 
fomriation from the information recording medi- 
um; and 

a reproducing device for reproducing the object 
data included in the infomriation read by said 
reading device, on the basis of the reproduction 
control infomriation and the reproduction se- 
quence Infomriation Included in the information 
read by said reading device. 

17. An information recording and reproducing method 
of recording the entire stream onto and reproducing 
one portion of the recorded entire stream from said 
Infomriation recording medium according to claim 1 
or 2, 

said information recording and reproducing 
method comprising: 

a first recording process of recording the object 
data file onto the infomriation recording medi- 
um; 

a second recording process of recording the re- 
production sequence infomriation file onto the 

information recording medium; 
a third recording process of recording the object 
information file onto the infomriation recording 
medium; 

a reading process of physically reading the in- 
fomriation from the information recording medi- 
um; and 

a reproducing process of reproducing the ob- 
ject data included in the infomriation read by 
said reading process, on the basis of the repro- 
duction control infomriation and the reproduc- 
tion sequence infomriation included in the infor- 
mation read by said reading process. 

18. A computer program for controlling record which 
controls a computer provided in said information re- 
cording apparatus according to claim 10 or 11 and 
which causes the computer to function as at least 
one portion of said first recording device, said sec- 
ond recording device, and said third recording de- 
vice. 

19. A computer program for controlling reproduction 
which controls a computer provided in said infomria- 
tion reproducing apparatus according to claim 14 
and which causes the computer to function as at 
least one portion of said reproducing device. 
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20. A computer program for controlling record and re- 
production which controls a computer provided in 
said information recording apparatus according to 
claim 1 6 and which causes the computer to function 
as at least one portion of said first recording device, 
said second recording device, said third recording 
device, and said reproducing device. 

21 . A data structure including a control signal, in which 
an entire stream including a plurality of portion 
streams, each of which comprises picture infomria- 
tion or audio information constituting a series of 
content information, is multiplexed by a unit of pack- 
et, which is a physically accessible unit, having: 

an object data file for storing object data, which 
is a logically accessible unit and is constructed 
by a plurality of packets, each of which stores 
therein a piece of the picture infomnatlon or the 
audio information; 

a reproduction sequence information file for 
storing reproduction sequence infomriation 
which defines a reproduction sequence of the 
object data stored in said object data file; and 
an object infomriation file for storing, as repro- 
duction control infonnation for controlling a re- 
production of said object data file, (i) corre- 
spondence definition information which defines 
a correspondence relationship between a plu- 
rality of packets, which are multiplexed on a 
time axis, and the plurality of portion streams 
and (ii) related group definition infonnation 
which defines as a related group a group having 
a specific relation from among a plurality of se- 
ries of contents constituting the plurality of por- 
tion streams. 
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